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ABSLTBACT ^ " 

This second volume of the summative- evaluation of 
*«Mah: A Course of Study" (MACOS)- presents results of quantitative 
^^analyses of what MACOS Students seemed to learn, what they retained 
" ^ne year later, and how what they learned was different from what 

studeats in other social studie,s courses leaned* The first part of 
' the do^cument compares MACOS and non-MACOS cl'^sses with regard to 
characteristics of students -and teachers, atd climate and processes 
in the classroom*. Characteristics computed for classes included 
ability grouping; avetage age of students;^ and percentage of students 
who were white, female^* and male*. Characteristics computed for 
teachers included edU'cational background, sodigil studies, objectives, 
and preferred teaching methods. Ho significant differences were found . 
betweeil the two groups of classes with regard to pretests of 
achievement, attitude*, demqgraphic char act erj.si:ics, or class 
^ ^cpaposition. The typical class in both groups jBas predominantly 
white, urban, and non-low income* The Second part of the documenj: 
pre*sent*s pre-"* and ,posttest findings, and folio"6-up information, All \ 
classes were given attitude and ach^ievement tests* Pretest 
instruments were also' administered to teachers* Findings indicated 
' that HACOS students scored significantly higher than 'non-MACOS 
students on the MACOS-specif ic pos'ttest; scpred similarly on more 
generalized tests of social studies skills; lear^ned more about facts 
and terms than abstract concepts; and tended to 'like;. social studies 
* more than iion-MACOS students* (Author/DB) 
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m. QUifNTlTAIlVE RESULTS 



• A. Intr oduction - . ^ 

In this section, results of quantitative analyses are presented. The 
section is organ&ed in two main parts: 1) analyses of the beginning charac- 
. . teristics of groups; and 2) findings. The first deals with the characteristica 

of MAC OS and non-MACOS groups at the out The second part presents the 
t> results of ana lyses*©]? groups with respect to pretest,, posttest, Follow-up 1, 
/"and Follow-up 2 outcomes. ^ ^ • 

In most analyses, vDriables have been treated as falling into one of ' 
three major grpups: - 



. Inputs - measures of initial characferistics of students, teachers, 
and classes ' ' ' ' , . 

. Processes and classroom climate-^ - measures of activities and 
attitudes toward the^ classroom made, during the baseline year 
(after pretest, before posttest; sepcifically, Feb./Mar.-,- 19T5, 
midtest 2) ' . ^ 

.Outcomes - posttest and follow-up achievement and attitude" variables. 
Furthermore, in ijiost analyses the class is the unit of analysis. This 
was done to eliminate the correlation of;scores among students within classes, 

r • ' * * 

and tKufl tcprovide independent units of analysis.- Thus measures, of student attitude 
or achievement are class means. Those means are based on Results from students 
-w'ho took both pre and posttest. One consequence of this approach is that conclusions 
'apply to classes, not to individuals. Analyses of the data collected in this study 



1. Classroom climate (satisfaction with class, for example) could be regarded, 
as an outcome/ Some analyses were made treating climate variables as 
outcomes: Most analyses treated climate as a moderator or predictor of 
outpomes. ' . ' ■ , 



^ ' • . - - ni-1 
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have not attempted to address questions such as: what kind of student seems to . 

derive more (or less) from MACOS? Are there aptitude-context interactions 

(differential structural or grpufi effects)? Are there aptitude-context-treatment 
•2 

interactions? ^ - 

' o 

Characteristics of classrooms were based on class percentages (fof 
.^fecample, percentage of females; percentage of students for whom English was 

a second language; percentage of students not eligible foi free lunch program; 

percentage of 5th grade students - to take non-graded" classes into account - etc.). 
/ . Characteristics of teachers were treated as another set of attributes 

of classrooms. For cases in which a class had more than one teacher (e. g. , 

team teaching situations), the attribute w^s the average for the teachers on 
^ variables for which It made sense to average (e.g. , sex was not average^^^d j 

not used as an attribute; Educational Scale Vn scores were averaged and used). 

Class characteristics pertVinicg to-stud§^t|3 were based on all students for whom 

ft - o • 

the project had data,^ not just >re-post students*. ' ^ ^ v ' ^ 

^Analyses were also made of responses to some items or questions in 
pretest, posttest and Follow-up 1 and 2 in which the individual is the unit of 

analysis. In those cases, care has been taken toMdentify sueh analyses cleai^ly^ 

' ^ * , • - * ^ 1. , 

and to delimit interpetations accordingly. , o ■ 

<> . \ - 

The aims of analyses have been twofold: 1) to determine whether there, 
were differences in outcomes between MACOS and non-MACOS classes; and 

2) to investigate relatiQnsh/ps,between groups andrwithin groups, of input and pro- 

^ ' ' \ 

z ^ • , / ^ 

"^2.- Analyses haveJ^een made of tfie posiSible effects of districts and schobls. 



c.ess variables to each other and to outcomes* The basic plan of analysis has 
beenjo: 1) create a reduced number of input and process/climate variables 



by a.prittcip^l components analysis of sets of variables; 2) aftalyze differences 



in outcome between aad within groups using analysis of variance and covarlance, 

. and fixed order multiple regression techniques; 3) analyze relationships among 

sets of variables for both groups and within each group, using canonical corre- 

lation analyses. At different stages, supplementary anal5'ses have been made to 

test hypotheses related to the stage^ 

Several critical points heed to be stated at the outset. Flrst.the quanti- 
/ . ' ' ' ■ ' . " 

tative analyses and donclusions to be discussed in this section are not the total 

...V , ^ \ ' " .' ' . ' ' ' 

findings of this |[&^y. Much time'.^nd effort was spent obtaining and examining 
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qualitative information from students and teachers. The information obtained 
bears importantly on questions t>f what was done in classes, what^the context of 
classes wan, what students made of their classes, what teachers saw as strengths 
and problems of different courses, how students remembered their social^ studies 

course the following- ye^r, apd.so on. The results of repeated interviews with 

♦ 

students and teachers are given in Section V of this report* It is believed tliat 

they contribute substantively to a more complete understanding of MAC OS and 

• * 

• Don-MAC OS. classes than can be obtained solely from the quantitative analyses. 

* Other sources of information have also been examined and analyzed to obtain . 
fuller understanding of wi^at teachers in both groups did and why. Second, a 
number of theoretical and methodological issues and problems are inherent 

^ in a study of this kind. One is the problem o| inferring causality from cor- ' 
9 relations. problem arises in part frorxi the fact that the design of the 

- " ' ■ * III-3 - ' 



study is not experimental. It also arises from the fact that detailed, continuous 
observation of classes was not possible. Therefore, determination^f^vhat was 
Actually done (the specification of prtx^essesf hwiir 

sources (ratings and reports bjrrstudents and teachers, interviej^rC with students 
-and teachers). . Also, there' are issues concerning the falHbility'^ef^ttcasur^s, ahd 
appropriate methods of analysis. . , " - ' 

There is a large literature on thfe methodological problems and^pitfalls 
involved in the analysis of non-experimental data and the interpretation of the 
.effects of correlated and fallible variables.^ Analyses repoi^ted in this secfion 
havis attempted to take cdgnizance of the methodoltJgical (and conceptual) problems 
in the field. The study has employed the strategy of cross-checking by use of 
several different analytic methods. But even that strategy does not assure de- 
cisive conclusions. Different methods or procedures apply different mo- 
dels and ask different questiofls of the-data. Not all possible methods were em- 

y 

ployed. No^ne method can resolve unresolved-theoretical issues, aor is_it clear 
what combination of methods, is optimum in ttfe face of particular theoretical un- 
certainties.^ In the absence of repliofation ond cross-validation, (g^clUsion^m^ust 
be tempered. . ^ . 

The spirit of this inquiry has been to illuminate, not to pass judgment, 
but even illumination has its limitations*^ in time and application. Jhe most that 
thft study says is that if jone wants to use MAC OS, here are some factors to con- 
. sider based on how it was used by a number of teachers and their results. It is 
a study of classes in varioift settings in which no attempt was made to influence 
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what should be teught or how. On tlie contrary, ekpllclt effort was made to - 
.avbld,that. It Is thus a study- bf a variety of MAQOS and qoq-MA30S courses 

« - ^ _ * " • k 

that w'ereimplemeat^ in a^^ariety of ways-ln-a-variety of settings. 
B.^ Initial Characteristics of Groups » ^ 

1. Classes and Districts 

Ther^ were 108-classes distributed among 15 districts in 11 states. 

The distribution of classes, by group and grade level, is shovwtjn Table ;il-l; 

. - . , ■ ^ • 

* * ' . - ' ■■ Table in-1 

. " . Ntimber of Classes by Group and Grade :|ievel 

Group ' 5. 6 Non-Graded> ~ Total 

MACOS ■ 20 20 IT' ; .57 

Non-MACOS^ 24 ^ 20 7 * 51 . 

. • Total . .. ' 44 .■ 40 ■ ■ 24 / 108 

- •• • . - ■ ■ . • 

Table III-2 shows the distributton of classes by group and district. 
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Table ni-2 . ' . ' 






Number of Classes by-Group" and iJistrict" 










District 


MACOS.' 


Non->i?COS ' 


Total 


l.„ 


5 


5 


10 


. 2. 




'4 ■ 


^8. 


3. . , 




- ■■ ^1 


8 


4:- 


■ ■ I- ■■ 




'6 


' 5. ' 


*3 


4 


-7 




- ' .2 


• 'C^ 


4 


;>: 7. 




4^, 


8, 


8. 


• - • 7-. 


4 


11- 




8 


' 3 


■' 11 


' 10. 




4 . ," , 


■ " 8 ■ 


11. - 


. 4 


4 


• * 


12.' . 


1 


3 


4 


■ 13.^ 




4' 


.6 


• 14. 


* 

4. 


■•4 - 


■ - 8 


15. 


2 


. . 1 


3 


Total 


'57 * . . 


. 31 . 


108 - 



3. California^ Colorado, Florida, Illinois, Iowa,. Nebreska, New jTersey 
bregon, Pennsylv^anla, Virginia, Washington. Districts, teachers- 
'and students were promised anonymity in this s1;udy. Eyery effort has 

III-5 • , . • * 



. . • • - -wj'-' - ■ 

, .r- ' ' - *^ ^ * ♦ " • » 

* * . The process .by which districts, sbhool and teachers entered the project 
were described in Section HA. A further .description of a number of characteristics 

of districts is given in Appendix __B^ VoI,»III. • — — 

2l " l^fssignment Characteristics of Classes ' . ^ 

r — J ^ : ^ - 

In order to ascertain whether there were systematic differences between 
MACCA and non-MACOS classes with respect to assignment of students ,Weachers 

^*ere asked how classes were formed. In the majority of cas^s in both 

''\ * ' % ' . ' 

/ - ' > 

groups classes wei;e formed on a random or heterogeneous basis, or on no spe- , 
cial basis. ^ In some cases teachers described^ classes as consisting of particular 

« t . ^ \ 

.abiltty groups or formed on othier bj^ses such as interest, compatibility with the 

$ . • ^- " ' * - ' ' ■ 

teadller,- absence of reading problems, etc. The overall distribution of assign- * 

wcent characteristics for the t>Vo gifeups is shown in Table 111-3. 

. , ^ \ '\ Table'ill^s' , * ^ ' ^ 
. * ^ . Bases of Assignment*to. Classes 



1 ' ' No Special Basis • Some Form 

Random; Hetero- * of Grouping No 

gepeous^jrbuptog or Selection Data Total N 

; MACOS^ ^66.7% 24.6% ♦ 8.8% 100.1%. 57* 

' Non-MAaOS" '76.5 ' - 13.7 9.'8 100 51 - 

' '*^ay not add td 100% due.to rounding 
There w&s' somewhat moi>e variability of assignment characteristics 
in the MAC OS classes. The two overall distributions weYe not, however,* sigr 
nificantly. different (X^ =2\ 019, df^"" 2, p'>.3C). ^ - ' . ' ' , 

been made in this report to protect that anonymity. The computer data 
files. contain no nagies^ only code numbers/Coding has not been done ' 
according to alphabetical orders or other systematic bases. 



3. Charact eristics of Students:. Pretests . ' * , * • 
. * ^ Pretest cl\aracteristics<of Students, based on class i^^erages, or half-^ 
class averages, are listed in Table Table III-4 shows the overall means, 

standard deviations (SD), standard error of the mean (SEM)/ th.e obset'ved range of 
class means, -and the number of-classes ^N) for ttffe MACOS and non-lJlA'cdS groups. 
In, the cases of the Questionnaire About Animals and-People (APy and thie STEP 

tfest, the data are giVen-for feub-tests as well aff, total Scores.' 

\ ' o - 

It*is important for the reader to bear in mind that Table ni-4- givesr . 
1)' statistics on classes (or balf-classesK nojt on. individual Students; 2) statistics 
based. only on students kncwn to have been in a^particular .class all year; and»^ 

3) in the caee of attitude scales, sitatistics based on average scple scores for ' 

" %• ' ^ ^ ^ 

individuals who passed predetermined exclusion rules with respect to number of 

scale items completed validly.^ Achievement means are based on total raw scores 

Thus, the figures pertain to classes jfnd wer:e tl6rived from students who were 

♦ • 

associated with a cla?s all year, an4 who, in the" case of attitude measures, had( 
wh^t was deemed to be sufficiently valid data to be used in computing class means. 
With ono, exception noted below no comment on the significance of differences 



4. . Foi* example,* ^\WA consisted of 5 items. If a student omitted more than 
one on pretest, a^mean was not computed^for the student; simiPafly for • 
posttesf . Either case would exclude the student from-the cTass means, 
pre and post. If the student omitted one" item on pretest and one on post- 
test, Jthe pr/3-post averages were still computed" for the student and 
included in the class means. Tfie ^exception was Study.Choices (SS Ch) . 
That was scored by, counting the tiumber of times social studies was chosen 
when'paired with another subject. If a student oitiitted (or nJarked in- 
vaiidiy) orfe or 'more pairs containing social studies, the scores were not 
•included in the class pre-post m'eans. Generally losses were small by ' 
the exclusion criteria applied. ^: . \ 



0 . 



T-able ni-4. 



- X 



. • , .\ J ••'Means, standard Deviations (SD),., standard E 

\ ' \- \ 'j^nge, and Number of Class e6-(N)j for Pretest^, by Group , * 
. * \ (Pretest) y " * \ 



> - 



«• 00 





, — , . : — ^— 2 , 1 

Mean ^SD"'' *SEM . Rarfge \ * . * 


7 — » r 1 


X- ' Animals and 
.People (AP)*v. . -. ^ 

a# 'riocai'DCore 


kl9;.01 '4)26 >,56 - 9.67-26.57''o 57- 


• r * ^ / • 


•b. Questions 1-4. 

- XTTXLAIACIIO ^ClL\i, 


. 2.17 .29 ^;50-15.2D' • 57 

< • ! • , / « 


10^06 1.6S ^ .24 4'/75-13.77 ^ 51 • ^ 


Questiops^* 5-8 
Netsilik part 


} 

8.5/ 


2.66 .33*' 1.00-13.^8 ' 57 


8,68* 2. S5 ' .'^2' • - 3. B9-13..od ■ 51 






.1 ■ ■ , • . .' 


^-^^ ^ — : ■■ ^ 


2; STEP 

a. Total ^core 


28.79 


5.-73^,' .77 ^'iS. 38-39. 88 56- 


, 28.08 5.60 - .79; .f6.*84-40,60 •* 50", 


o.^ DUO ir, urgu— 
n];sing Informa- 
tion - 1 


3.65 , 


.80 .11 1.50-5.32 56 


^ i- ' : * . • 


c.^Sub^, Ipter- / 
preting Information 


14.27 


2.89 . 39 8. 00-19. 68-, . ' 56* 


13.93 2.78 .39 8.59-20.95 - 50 


d; Sub 3, Assess- 
ing Adequacy pf 
Data- 


2..80 

■ ; 1 


.61 ■ .08 1.50-'4'.25 , 56 

- • *•*>..• " ' • * . 
■* , \ ' -' ' 

J, " .J 


- 2.71 .67 .09 1.26-4. 05 50 • 


•e,r Sub/4,' Drawing 
Inferences, 
Generalizing 


6.59 


1.^4 .17 3.33-8.92 * • 56 

* 

-> w 


6.50 ' 1. 21 .17 3.84-9.G0i. " 50 ' . 

' ' ' ■ 


f. Sub 5, > . 

Reaching 

Conclusions 


1.48^'. . .38/ .05 i -.86-3.00* 56 


a. 38 ;37 '5.05 '<J54-2.05 , 50 

^ - ■ ^ T" 



1. See Appendi;^ E (Vol HI) for pre, post and follow up statistics for these me^ures. 

- 

i / /} - • . ' - ■ - 
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TablaiJII-4 Continued 



MACOS 



Instrument * 



Mean 



SD 



SEM- 



Range 



N 



Mean 



SD 



No n-MACOS 
SEM 



Range 




N 



3, Interpretation 
of Data Test (IDT) 



8.95 



1.45 



.19 



5.80-13.11 



57 



8.78 



1.54 



,22 



5.46-12.00 



51 



4.' Social Studies 
Choices (SS Ch) 



2. 33 



,75 



.10 



,86-4.44 



57 



1. 99 



.72 



.10 



.42-4.04 



51 



-♦/^Sr'v^What Woulia 

You Think 
• • a. WA 



*4.87 
5.48 



,26 
,27 



.03 . 4. 38-5. 39 \ 57 
,04 4.87-6.01 \ 57' 



4.80 
5. 40 



. .31 

.36 



.04 
.tf4 



4.20-1,. 35 
4.58-6. 11 



51 

51 



T" 



.-.-6. Children'^ 
.Attitude Toward 
.Problem Solving- 
(CAPS, Factored) 
a. CAPS-1, 
^ Ability 



2. "84 



.26 



,■03 1.95-3.36 



57 



2,88 



..27 



.04 £-\ 2.30-3.40 



51 



„ b. CAPSr2, 
Interest 



3.79 



.20 ' 



.03 3.33-4.15 



57 



3.82 



,19 



,03 -3.17-4.20 



' C. CAPS-3, 
Xoleranceof 
• Ambiguit'yt 



2. 91 



.26 

7 



.03 2.22-3.44 



57 



2.87 



.25 



,04 



2.40-3.43 



,d. . CAPS.-4, 
Creativlty"^ 



3.11 



,20 



,03 



2. 67-3.88 



57 



3.12 



.19 



,03 - 2; 66-3. 57 



51 



51 



51 



betwefen groups will be made in this sub-s^ctWn, RmuU^^ tests 
of bBginning. characteristics of the MACOS and non-MACOS groups will be given, 
in Section in C-2. . ^ * 

. 4* Characteristics of Classroomfl 

A number of characteristics of class e:s_w ere compjited> These charac- 
teristics, such as average age, were based on data provide for each student by 
the teacher; Eleven such variables were computed for e^ch class: 

^ . average age of studentSt-in Jxionths_^ 

* K - - " ' " ' 

, percentage of students who were female 

. psrcentage of students who were white ' * 

, percentage of student^ not eligible for the free lunch program - 

/percentage of students for whom English was the primary language, 
not a second language'(notESL) v . - 

• percentage* of students who had not previously had any MAC OS " 

, percentage of students who w6re 5th graders (to take non-graded ^ 
classes into acfcount) " , ^ . , 

' \ ^ , average reading level, based on a 5-point scale on which the teacher 

classified each student on the basis of his/her latest reading achieve- 
ment scores (1= more than 1 year above grade level; 5 = more than 
1 year'below grade level) - * 

, average" number of years students in class had been in pregenfr school 

« 

* I 

. size of class, based on the tt)tal number of students known to be in 
the class at time of posttesting, even if not at pretesting 

' . stability, the ratio of students foe which there were pre-post 
data to the total number of students'for whom there were any 

* t ' * \ 
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pre, midtest pr post data>^ 



Table III-5 gives the mean, SD, skewness (SK), kurtosis (K), observed 
range and number'^of classes for each group. 
5.' Characteristics o f Teachers 

Descriptive statistics of characteristics of the MACOS and non-MACOS 

^ . \ , - ' ' , " . ' 

teachers that are used in quantitative analyses of results' and relatioijships are 
given in Table III-6. The table shows tor each grqjip* the mean, standard devia- 
tion^ standard error of the mean, observed range, and sample size for each 

variable, ^ 

. ■ , - 9 * 

The Objective Categories listed in Table 111-6 ^came from the Social 

Studied Program Survey Form, Part n. Part II contained a list of 40-oblectives. 

» 

Groups of objectives were intended lo be related to different major program 

ir 

emphases^-listed in Part I of theiorm. Teachers were asked to rate each, objec- 
■ It" , • 

tive with respect to its importance. Eatings of the group of objectives in each > 

* - ' ^ - ■* - ^ 

category were summed and averaged. Thfe abbreviations listed in Table 111*6 

refer to the following category titles: ' t - ' 

... f • - 

Tcat 1 (CT): citizenship transmission objectives 

.Cat 2 (CD): cross-disciplinary ^humanities/integrated conce[)t 
^ f * objectives - • * 

,Cat 3 (IMP): inquiry modes and process objectives 

^ .Cat 4 (SA)t self-attualization objectives. ► 



/ 

5. This is not, obviously, a beginning characteristic of a class, nor a ' 
pure measure of stability. Jt is included here as an index ^ the class 
on which student means^ were based, relative to all students knawn to 
havebeen-associated with the class at any time* ^ 
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Table 1II-5 

Mean, Standard Deviation (SD), Skewness (SK), Kurtosis (I^, • 

^ Range, and Number of Classes (N) for Classroom^ 

Chara'cteriVticsr byVGroup ; ~ 

MAC OS ^ Non-MACDS. 



Characteristic 


Mean 


SD 


SK 


K ■ 


Range 


N 


Mean 


SD 


SK 


K" 


Range 


N 


' 1. Age 5iilnonths 


131.6 


5«67 


..42 


-l.-07_ 


■ 121.3-134.5 


57 


132,0 


6.22 


-.96 

0 


- -1,29 


120.6-142.7 


50 ' 


2. Percent 
- Jiemales 


48,96 


10,10 


,16 


1,35 


20.00^77.78 


57 


51. 09 


9,99 


-, 11 


-. 20 


' 31, -03776. 92 


51 


3. Percent white 
students 


.87.91 


16. 66 


-1. 60 


1, 50 • 


37. 50-100 


57 


87, 36 ' 


18 J)fi 


— JL . / o - 


9 "^Oft 
4^20 




CI • 

51 

\ 


• " ' ,4. Percent not 
eligible for free 
- lunch 


86,42 


13.42 


-1. 20 


\ .81 


48. 28-100 


57 






<*^— JL. OX • 


0 Q £^ 

" i 




C A 

50 


' 5. Percent not 
V a ESL 


98.^8. 


''^ 4. 12 


-2.65 


' 5. 86 


82.a'4-100-- 


_ ,57 - 


-97.19- 


- 6.-71 


-3.66 


15. 66- 


60.-87-100 


-51- - 


7 6. Percent not • 
• M .previous MACROS 
students 


93.11 


19.5a 


t3,51 


11, 13 , 


8, 70-100 


57 


99. 07- 


6. 07 


-6,94 


45:45 


' 57.14-100 


50 


7* Percent 5th 
graders 


■ 47.97,. 


43.45 


.30 " 


-JL65 


0-100 - 


57 


53. 69 


47. 22 


-, 14 - 


' -1 84 


. * . u— xuu 


^1 - 


. 8. Reading level . 
(S'-point scalV) ^ . 


'2.81 


.61 • 


' ,64 - 


1.11 \ 

-1 


1. 28-4. 56 


57 


2; 74 , 


•54 


-. 02 


-.11 . 


.,M. 48-4. 09 


oD • 


♦ ^9, Years present 
. school ; 


3.91 


1.09 


-, 26 


-.28 


1.36-7. 00, 


'57 


4:i"8 


1.12 


-.35 


. 30 ^ 


1-6.7 


51 


. 10. Class size ^ 


- 28! 98- 


10.87-* 


1. 88 


8.96 


^ 9r-82 


57 > 


28,'20 

t 


6.00 


-. 37 


.68 


13-40 


51 


* 11. Stability 


.73 


.17 


-. 61 


-.17 

> 


. 3-1. 0 


57 


. 78 

V 


13- 


-1 14 


x» xo 




^1 

01 


.- 16 










1 

e 


* 


* 








c 

t 


i 










\ 






• 




• 









Table III-6 . ' 
Means, Standard Deviations (SD), Standard Errors of the Mean (SEM), 
.Ranges and Sample Sizes of 'Selected Teacher Variables.by Group 



1 








0 

MACdS" 


0' 






.Non-MACOS 








Variable 


Mean 


SD- 


SEM 


Range 


N 


Mean 


SD 


' SEM 


Range 


N ■ 


— 7 *. 


^ 1. Years teach- 


; 9,26 _ 


7.37 


• 1.01:; 


0-33 


53 


9.80 


7.67 


1, 16 


1.00-40 


44 


























* 










2. Years- taught 


6.04 


5.72 


.79 


' 0-27 


53 


7.18 


5. 63 


.85 


1.00-28 


■ 44' 




, iiX present disti'ict 








































Years taught 


2.30 


1.06 


.16 


1-4 


46 


- 2.51 


^.11- 




1.00-16 

0 


37 




^ present program 
















' \^^1^ 








(1st year =1) 


















9 

m 




>— • 

— "I— 1- 


4.EducationaL - 






















' . »-< 


Scale Vn - 


86,21"° 


8 . 4 I7 


' - 1,17 


65-103 


52 


: -S5.-51 




— ' ^1. 36 


66-105 


45 , 


*w 1 


a»' . Progress iv ism 
score 


— 9.-11— 


* o 


b. Traditionalism 


55.00 


9.'81 . 


1.36 


36-86 ' > 


52 


58.;91 . 


•13,45 


- .'2, 00 


18-83 


45 




score 
























"* 




—5- 












. 5. Teachers at 


14,42 ■ , 


3.37- 


- • , 46 


7-24 


53 


15.74 • 


4.^05 


.-60 


'8-26 


46 




Work (TAW) ' 


/ 






























6/. 'Objectives' 
























a. Cat 1 (CT) 


" 2,34 


",62 


.08 


1-3.6 


' 54 ' 


2,38 


',55 


-.08 ■ 


1.2-3.6' 


48 




b. Cat 2 (CD) 


1.67 


.55 ' 


.07' 


. 1-3.0 


54 


1.91 


,52 


.08 , 


1-5.. 7 


4« 




c, CfltSdMP) 


1.59. 


y. .51 


..07 


1-3.0 ^ 


54 


, l.p2 


-.50 


.07 


1-3. 2 ^ 


- 48 




d. Cat 4 (SA) 


1.94 


.56 


,08 


1-3,^ • 


54 


2.35 


.68 


.10 


• 1-4. 0 / 


48 . 




^ e. Cat 5 (SS) 


• 2.48 


.&1 - 


■ .08- 


, 1-4. 6 . 


54 


2.66 


■ .56 


.08 


1-3,0 i 






- f. Cat 6 (Vf 


' 1.71 


.49 


.07 


1-3.0 „ 


5': 


1.94^ 


.53; 




1-3.0 


48 . 




g. Polit 


2.40 


1 .12 


.10 


1-4, 0 


54 


2.36 


,60 


.09 ■ 




48 


h. Gen ' 


l.»96 


.51 


• -.07 


1-3.4 


54 


■2. 08 


,41 


.06 


1.4-3.^- 


48 










«_ " 


, *" 
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.Cat 5 (SS): the social sciences objectives 
.Cat 6 (V): values clarification objectives^ 
.Polit: political relevance objectives- 
*rGen: generakqoclal studies-objectives 



There were other bapl^round characteristics of the two groups of 

teachers that were not selected for use in major quantitative analyses. They ^ ^ 

are given below in a series of tables in order to provide a mofe complete ^ 
» ■ • «^ 

descriptive summairy of the b^inning characteristics of the tworgroups. These ^ 
tables will not be numlbered separately, to save space. They are simply identi- 
fied by variable. All tables ^re in percentages 6f teachers In each group ^or 

s ' • * — ■ , ' 

whom there were data. It should b^e noted that sample size may be greater in 
sdnie cases than'the number of RC^C.O^ .or t>on-MA.COS classesi* That is be- 
-^cause there were a few cases (in botlTgroups) in which more than one teacher, ' 
(foy example, in a team-teaching sitiiation)comRl'(etedthe Teacher Master Record 
Foym. TRbse responses are included here. ^ ,, - ' '■> 



MAGQS 
Non-MACOS 



Sex ■> 
Male ■ ' Female " 
47% '•' 53% • 55 
35 . "65 48" 



a 



■ r 



MAC OS 
Non-MACOS 



, Race- . 

1 '2 3' . 4 _5 
2% 97%, 2% 

2 -98 V - 



N 

57 



1. Black- 

2. 'Americaji Indian 

' 5. Other 



. 53 ' 

.3. White 
4. 'Oriental 



A^e as ot Janu^pyrl974 



. \ « ~ — 

Age 
. r 20-25 \ 
26-30 ' 


MACOS(N=58) 
. 22%- 
■ '29 


Non-MACOS(J^=51) 

\29% ■■ • 
14 ■ 




■ - .-31-35" 


.. 19 


, 21 






• " * 36-40-.. ' 


9' . 


12 


- -a 




-—- r-^^.--«r^-~-. - .41-45---. 


—.10 ' ' 


J.2 






. 46-50 


. ' 5 


2 — 


t(Vl'- . 1— " 




51-55 


' 2 


4- 






-- " 56-60 


2 • 


2 






' ^» 61 dt over 

r 


2 

100% ■ 


4 - 
100% 


»« - 

c 








Identify with an Ethnic Minority? 








. Yes No 


^ N 






' MACOS 


13% 87% 


53 






,Non-MACOS - 76 


-'j45 







Education: Degrees "or Certificates Earned (Ctieck all Applicable) 

4 ■ / 5' 
19% ■■/ 3%' 
18 / 10 



MACOS* 
Non-MACOS 



1 

•2"0% 
23 



-2 
76% 
67"' 



3 

9%. 

12 



/ 



6 

,19% 
18 



59 
49 



1. _AA _ 

2. Bachelor's Degree 

3. MAT 



4v Other Master's Degree 
5; Master's' pius 30 hours 
6. Other - 



Type of Teaching Situation at this time (Check all applicable ) 



' ' "1 2 1 

MACOS 43% 45 15 

Non-MACOS 60^^ 38 23 



4 


5 ^ 


6 


7 


' N 


28 \ 


11 


23 


4 . 


53 


13 ^ 


. 2 


21 


11 


47 



1» Self contained 
2. Team teaching 

Departmentalized 
4> Open-Space 



5. Demonstration classroom 

6. Non-graded ^ - 

7. Other 
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What giibfect do you most enjoy teaching ? 



Subject Preferences , 
/Social Studies. 
Math or Science ^ 
Language Arts 
Reading 

Other Single Subjects 
All bther (Combinations) 



MACOS(N=57) 

. 21%^ 
23 

• ■ ^ 
■ 'I- ■ 

100% 

*Does no6 add.fo^lOOitJuvto-rounding 



/. 



Non-MAC06(N=49) 
22% 

20 , . 
■ 10 

6 ' 
. 10 ' 

. -31-- 

- 99%.* , 



1 



T 



Some teache^ responded to this question)by listing several subjects. 
The lists given b^-^lfferenl^^achers sometimes included social studies, some- 
timewiot.. Tcfachers gi^ring multiple responses 'are classified above under 'All 
Other. (Combinations)*. The category also "includes two teachers'who said 'All 
SuMects% and one who said ^No Preferfenc^e*. The category « Othei; Single Sub- 
j.ects* includes such subjects as hiusic, art^ health, etc._ 



Special Areas of Training Related to Social Studieajv Pre-Seyvice^ " 
/ ' / or InrService * ' V 



1 



10 11. 12 . N- 



MACOS 
Non-MACOS 



73% ^2 75 55 50 60^' 57 63 53 37 45- 32 60 

6% 58 62 57 42 51 55 51 ^ 58 30 42 38 53 

1% Social and emotionardevjplopment ^ ■ . 

2. Developing cognitive skills * ^ * 

3. ^Teaching inquiry methods - _ _ ^ ' ■ s 

4. Teaching How .to analyze values and value'conflict _ * 
5. . Teaching. irf^erpersonal skills to students 

. 6. Teaching social science methods *and techniques V ^ 

7, Developing self awareness in students 

8, Use of questions as an educational method 

9, lifeading and/or evaluating classroom discussions 

10. Teaching how to analyze'social issues 

11. Integrating social studies with other su^ects ^^ . 

12. How to increase relevance of subject matt'er lo students 



/ 
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Pre-Servlce Training in Social Stydiea • t> 

• (All training before becoming ^eacher of record) 

.Did trainfrig include courae(s) in social studies methods? 

« 

Yes No ■ ■ -N 
MACOS 83% ' ;i7% - "60 • 

Non-MACOS 75 25 , 51 ^ 



. If Yes, was it undetgraduate, graduate, or both? 

^_ Unde rgraduate Graduate ^th IL, 

MACOS ■ """7— ^6%=::rv.^__— 6^ " ^. 50" 
Non-MACOS . , 66 . — 24 .. ' 38 

. Did pre-service teacher training include any other courses,. 
specifically concerned with teaching social studies? . 
- ' - - ^_^Ye^ -"No N_ 
MACOS. . 21% ^ -53%. - 58 

Non-MACOS . 21 T9 47 : — , . 



„ ^_ j[a Service-Training in Social Studies , _ \ 
(All training received since becoming a teacher of record) 



. Have Vou received 'any in-service training pertaining to teaching social . 
studies? . * • . -\ 

Yes No. - N, \ • 
♦MACROS - 67%'' .33% 58 \ ■ . .: 

Non-MACOS 48 52 44 ^ ; 

. \ - - ■ - - \ - t 

X' Th<; Verbs for Objectives Form.<VO), described in Section HB 2 1, / 
wgs not used in major quantitative analyses. This instrument Was intended to / 
prbvide one measure of teachers' tendencies to consider appfication-orlFnted ' 
objec/tives as important. It was s6or.ed by counting the number of titnes out /of 
.6 a/iigh appli.cat'ion rated verb/was selected from an alphabetized list of 3p verbs. 
We distributions^of.perceYitagefs of teachers, choosing a given number appli- 
at ion verbs are shown below: ' _ * 



* f / 



Number of Application Verbg Chosen Out of Six I 



9 



' 0 ■' ' 1 ■ 2 ; ' 1 * - 4 5 « ■ N 

-MAC OS 18% 34% 23%"" 21% ' '4%- . 5% ' 56 -.' 

Non-MACOS 24 45 "24 .' - 8 0 . ,0'- -ft 51 



Basqd on a Rypergeometric. probability distribution; the exact .'probabi- 
lity of each possible "number of selections is: . * < 




• P 
.. 2?67 
.4295 
.'2684' 
.0682 
.0070 
. 00i)2 
.0000" 



Erom thisilKcan be seen that the cumulative pr6bability*Df picking 0 to'l 
verb by/hance is . 6562, while the c»inlulative probability/ of picking 2 ^.more ' 
bycMnce.is .3438. 'Each distribution (MAC OS, non-:MACOS)^f selecjians»w?as . y 



tested against a chance expectation by a Chi-square test. of frequencies combjnea \ 
nto 3 categories: 0,1, 2 orinore selections. ^yor^He MAGOS groups, X^4' 690, 
af=2. pi . 10. For the non-MACOS group, •x2^/206, df = 2, p > ! 90. Thus Vhile ' . 

-.neither dtstribution exceeded a chance expectation,' the MACOS group wa^ some- > 

■ • / ■ . - , 

' / ' ' ■ v' 

what more likely to pick a larger numberybf application type verbs than the non-° - ' 

'MAC OS group. -When the distributions of the two groups wete compared with each 

. ' . - •' ' ' • i ' /. 

other, they were found 'not to differ significantly (X2=5. 120, df = 3, p*> :. 10): ' . 

Considering the whole distributions for each group, an index of pr edict ive:.asso<£i>- 



' . . ni-18 , - 



tlott was computed.® If Group is taken as the dependent variable there is^a 12^ 

reduction ia error of predicting group membership, knowing number of selections. 

There is,. however, no reduction in error of plredictlon in the opposite direction. 

Since the- overall distributions for the two groups were pot significantly different,-^ 

it was cohcluded that the strength of predictive association indices should "not be 

regarded as of consequence* ^ * ^ v ^ * ^ ^ 

C. Findings " ^ ' ' ' ' . * " - - *' 

1. Creation of Input and Process/Climate Principal Components (PC's) 

* .* * 

To reduce the numben»of input and process variables, principal . 

^ component analyses werp made of sets of variables J Sets were logical groups ^ 
of variables. For example, one^et was 4ite threetachievement'tests: A Questionr j^ 
nairg abouj^ Animals and Ptople {AP ), the Interpretation of Cata Jest (IDT), and 
the STEP , Social Studies, Series II, Form 4a (STEP). Anothex* set was the group 
of computed ctaSsroom characteristics such as average a^e of students, pef- 
centagQ of females, class size, *etc. The^ consequence of this approach Is that 

.resultant principal components- from different sets of variables were nbf necessarily 

- uncorrelated. * The reason for using logical groupings of variables .was to retain 
interpretabllity of resultant composites. While i't was possible to create a liniitecl 
nUmbet of composi^s from an ensemblte of meaningfully different variables which > 

> would have been uncorrelated, it was believed that, parsimony notwithstanding, the 
the ability to Interpret relalipnghips of composites to dependent variables was the 



6. Hayes, William L. , Statistics for Psychologists. New York: Holt, 

Rinehart and Winston, 1963, pgs. 60G-G10. 

7. Nle, Norrhan H. / et. aU SPSS; Statistical Package for the Social Sciences 
Second Edition. New York: McGi'aw Hill, 1975. PA 1 routine. Listwlse 

^deletion was used.' ^' * " - 



V 
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more Important consideration.. , 

Analysis was done using the^total array of classes from both groups. 
For any set of variables, a maximum of two principal components (which are the first 
two with the largest variances) was retained, JThe decision rule employed was - 
that if the first principal component (PC) accounted for 50% or more of the variance 
for the set, :only it was retaine4. Otherwise, t^ second PC was retained in 
addition. The reason for this decision,rule was parsimony, .The aim was to re- 
duce the nuxnber of covariates relative'^to sampl^izes, -There vyere eight sets 
of variables for which prlncipial components were obtaineii and four of the sets had 
only one or two eigenvalues greater than 1. 0. In three of the sets that had more 
than two eigenvalues^reater than 1, examination revealed that the difference be- , 

tween the second and third eigenvalue was substantial and constituted a break- 

" V ' , , - , • - - 

ing point in a curve relating eigenvalues to components. There was'^one set t 

-/(classroom process variables as rated by students) in which the "breaking point 

came after the third eigenvalue, but inspection of component structures for this 

.set showed that including the thirS component would have picked up bnly two more * 

variables ouf of a total* of 12 There'fore, it was d€Cided^to retain only the first 

two principal components for that sej:.* In sum, to keep the number of covariates 

i * 
as low as possible relative to the number of classes to be analyzed, and to 

i ^ ^ \ _^ 

retain interpretability of composites {covariates), eight sets 6f logically defined or 

related variables were reduced to either 1 or a' prinqipai components each. , 
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Table ni-7 gives the structure matrix Jot each set of principal com- 
poneats (EC's). * It also shows the eigenvalues of 1.0 or more for each set, 
and the cumulative percentage of ^riance accounted for by tHo3e eigenvalues. 
It caa.be seen ia Table,nM that there are a total of 13 PC's which will be 
referred to hereafter in the following abbreviated form: 

Input Principal Components (PC's) 

1. student Pretest Achievement: Ach " i K 

2. Student Pretest Attitude: Att i , Att 2 
3* feagher Experience: T Demo 

4., Teacher Pre Attitudes: T Psy 1, T Psy 2 

. ,.5. Classroom Composition-and Charact^ristics: ^C^ 1, Class 2 

Process/Climate Principal Components (PC's) ^ 

1. Process Variables a^s Measured by Student Ratings: S Proc 1^ 
^ SProc 2 . . \ ^ 

* 2. Process-Variables from Teacher Ratings: T Proc 1, T Proc 2 

3. Climate Variables as Measured by Student Ratings: Climate 
Table ni-8 shows the correlations of PC's for the total group; and for 

MACOS and non-MACOS groups. It can be seen in Table 111-8 that there are non- 
. trivial correlations among some PC's. For example,there is a substantial corre 
lation between the pretest achievement PC (Ach) and the first component of the 
attitude pretests (Att 1)^ It can also be Seen that in a fgw cases, there are sub- 
stantial differences in the intercorrelations of PC*"s betv.'een MACOS and non- 
.MAGOS groups. For example, for the MACOS group, the correlation of the first 
student pfocess. component (S Proc 1) with the teacher experience component 

/ III-21 . 

27 . 



Table III- 7 

Factor CorrehU ions, Eigoav»iliies and Cumulative Parcentagt 
* of Variance of Principal Componertts Analyses 



PC 



Variables 



to 



First Factor (PC) Second Factor(PC) 
Polarity crVariables ' Correlations Correlations Eigenvalues^ 



Cumulative 
9c {Of Variance 



Ach 


Animals and People (AP) 


Hiffh = 












Pre 






* * 




* 


Interpretation of Data 














Test (IDT) Pre 














STEP Pre 


-11 _ - 








1 


Att 1,2 


Social Studies Choices,- 


Higb = + 


i42 




^. I/O 






(SS Ch) Pre 








1.19 • ' 


46 




What Would You Think 


\ 


.70 


37" 


1.06 


62 * 




Part A (WA) Pre 














What Would You Think 


4 




m 




■ 




Part B (mVB) Pre 




.79 


.12 ' 








CAPS-1, Ability, Pre 




.29 


' .08 




• 




CAPS-2, Interest, • Pre 




*.32 


.71 








CAPS 3, Tolerance of 




' '.71 


J .17 








Ambiguity,- Pre 




> 










CAPS-4, Creativity, Pre 


II 


-.24 ' • 








Class 1,2 


AvejrageAge 




.69 


55 


9 '^ft 


99 *" - 




SD of Acre 






— . 0 * 


- O AC 


39 




Years in present school 






— . 40 


1. o4 


oU 




SD years in present 






— Aft 


1 hi; 


£JA 
DU 




school ^ 


* 






^1. 01 


69 




Tfc-iemales 




-.15 


.03^ 




77 




% not i2<SLi (English as a 




.35 


.53 " 








second language) 














% not eligible for free 


9 


.64 


' .55' 








lunch prc^gram 














% Previous MAC OS 




, .07 


02 








students 














% white students ^ 




.74 


.55 • 








% 5th grade students 




70 


.47 








Class size 




-.04 










Class stability 




.25 




• 





ERIC 



1 . Only values^ !• 0 are reported. 



28 



29 



PC 



Variables 



Table»in-7 Coiitlnued 

Factor Correlations, Eigenvalues and Cumulative PorcentagO 
of VariaYice of Principal Components Analyses 



First Factor' (PC) Second Factar(PC) ^ 
Polarity of Variables Correlations Correlations Eigenvalues 



Cumulative 
9c*of Variance 



t 

to 



T Demo ^ 



Years' teaching 
^experienSe v . ' 

/years in present ^scfhool 

^ystem ... 

Years experience with - 

present SS program' 



T Psy i; 2. 



Educational Scale VII • 
Progress ivism 
Educational Scale VII 
Traditionalism 

Teachers at Work (TAW) 
Category 1 (C'itizenship 



.V . . 



The^ higher the/score,the 



"Transmission Objectives^ less the objectives in,the 

category were rated as 
Category 2 (Cross-9is- iniportant 
ciplinary, • humaniliids, 
int^rated concept objec- 
tives)* 

Category 3 (Inquiry . 
modes and processes 
objectives)* 

Category 4 (Self-actua- 
lization objectives)* 
Category 5 (social 
s c i enc es ' obj ec t i ves) * 
Category 6 (Values 
analysis ob|ectives)* * , 
Political relevance 
objectives* 



ERJC rohi Program Surv.ey Form 



96 

,95 
20 



-.36 

*06 

14 
.63 

.75 

.79 

.77 
.73 
.79 
.70 



.51 
.87 

.5,7. ^ 
.4-2_ 

.12 ' 

.20 

.16 
,25 
.16 
15 



1.87 



4.7.4 
1.Y3 



. 62 



43 
59 



4^ 



' - . 










• 








' Table III-7Continued , - 




\ 






Factor Correlations, Eigenvalues 


and Cumulative P 


er^Qntcige 








of Varianc"e of Principal Comoonenls Analyses 








*» , 




First" Factor (PC) Second Factor(PC) 


cumulative - 


PC 


Variables 


Polarity of Variables ^ 


Correlations 


Correlations 


Eigenvalues 


Si of Variance^ . 


.T Psy 1, 2 


1 ' ' ' 

General social studies 


The higher the score, 


.87 


■ -.12 




• 


cont'd^ 


objectives 


the less the objectives 


• 












in the category were- , 


• f 




• 









rated as^mportant 


. — -~ ' 








S Proc.1,2 


Teacher Talk* 


- • 
High mjsans little talk - 


-.12 


.07 


'3.14 ■ '.. 


.. 19.6 V. - : 




Speed 


High means want to go 


r. 13 


-••24 


2.89 


37.7 " 




> 


faster 


•> 




2. 21 


. 51.5 • ., - 




Listen 


High means much time. 




.22 


1.27 ■ 


59.? 






just listening to teacher 






» 1. 19 


6fe.9 




Discuss Lon 


High means not much 


' -C13 


.71- 










discussion 












Stress ' ^ ^ 


'High means little stress 


.64 


-.49 . 










on grades - 












C ompare 


High means little emphji- 


• ^.12 


.63 










sis on comparing . 


• * 










Joking 


High means little joking, 


-. 56 


.07 


V • 








informality . 












Memory 


High means little empha- 


.70 


-.*22- 




• 






sis on remembering 














facts , r 








1 




Translation 


Hilgh means little empha- 


.58' ■ \ 


.01 










sis on restating or saying 














in own words 


* * 






• 




Interoretation 


Hicrh means little emoha— 


.56 


.52 










sis on interpreting what 












• 


things mean, , 












Application 


High means little. use 


.32 


- .38 ■ 










elsewhere of what's. 












* 


learned in school 

• * 


r ■ 

1 






•* ♦ 


;2fMy,Social Studies Class Form, Part I and 11..- 











' ? ; • TAblehl^ Continued 

FircforXWrcian ons / E igea>\nluea .nndrUmulat i ve Percentage 
• of'Variance p£ Prinpipal Com|)onents Analyses 



PC 



Variables 



Firsi Factor\(PC) Second Factor(PC) Cumulative 
Polarity of Variables Correlations ^Correlations Eigenvalues of Variance 

















S BtQC 1, 














Analysis'"*; 


High means little empha- 


■ .62 


.26^ • 

\ 




• 


2f cont'd 




s is -on completeness , 










7 


' giving good reasons. 




\ 


* 4 






making^ sense 




'« \ 








Synthesis 


-High means little em- 


.48 


.►.34 . 








• 


phasis on making new 
things^ creating from 


- 












what v\^s learned 


* 






* 




Evaluation i 


High means little e.m- • 


.17 


.60 






* 




phasis on deciding on 






• 








- right^^or wrong, good or 








) 


V 

QDI 


bad - . - 










1 

• 


High means little oppor- 
tunity for "discussion 
or involvement 


.03 

* 


• .58 

• 




f 


• 


Test/Grade Stress 


High is little emphasis 


.67 


.•-.54 






* * 




on grades or right 






• 








answers 


* 








T Proc 1, 


<• 

Affect 


/High means empliasis 
of currjculum' 


: .55 


-.'42 






2 - 
















on affective content 




* 9 


3.S2 


32.0 




Memory" 


High means. more em--- 


-.01 


- - . 58- 


2.32 


53. 0 • 






pha$is on remembering . 






1.19 


68.9 




Comprehension 


High means more em- 
phasis on understanding 


.05 


. .55' 
















* 




' Application 


High mean$ more 
emphasis on usin^ 
knowledge, problem * . , 


.61- 

« 


-.34 










solving » 

, »- 











ERIC 34 



35 
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• . . " Table ni--7 Continued . / ' 
Factor Correlatixrn^, Eigcavaluos and Cumulative^Percentago 
o^Varianco''dt^Eri^cipaI CbriVponents Analyses 



Variabtes 



. * ■ Firit-Pactor (PC) Second 'Factox*('PC) y ' Cumulative 
Polarity of Variables ., Correlt^tions. Correlations Sigenvalugs^ of Variance 



T Proc li 



Cont'd 



I— I 



Climate 



Arjalysis * 
^Synth^is 
Eyal'n 
Indiv V 
Group* 
EM ^ 

Total "Group 




SatisfactioB 
» 

Apathy 
Difficulty./ 




High means more 
emphasis 
High means more- 
emphasis 
High means fjiore 
emphasis - 
High/means more injli- 
vidual acti^'^tiefe 
High means more iroup-' 
^isciissipn activit/es 
High.means more per- 
ceptuaTmotor aotivitiea 
High. means more group 
activitlei?\^and projects, 
including discussions 



Low means more satis- 
faction 

High means less apathy 
I^gh means work is rated 
less difficull 



X 





.38 
.83 



r. 94 

.S3 
.•84 



-.10 

-.41 
-. 69 
.77- 
.23 
.69 
.26 



*2.45 



«1.8 



* 


» ■ 












• 


• 




1 




» 








> 

< 

« .- 


■ ■ : • 

■ . Table III-8 • \ . 
Correlations Between Principal Components ...PC's 
for total Group, T (N-81), MACOS, (N=45) 
4 and NoH-MACOS, NM (N=3G)- • " 




• 


• 


« 


o * 


PC ' Group 


<: 


• 

\ 

H 

< 


) 

< 


Mi 

03 

*— < 


« 

o 


* 

0 

g - 

- H - 


T-l 

• go ' 




SProc 1 
S Proc 2' 


% 

u 
H 




• 


* 

^. 


Att 1 T 
M 
NM 


56 
45 
68 












■ 
















Att 2 T. 
' M 
./NM. 


-01 
-02 

02 


ii 

01 




o 










* 




ft 








Class' 1- T- . 
M 

- ■ ■ i' NM < 


73 
73 

72 


40 

'28 
,'70 


-13 , 
-15 






• 




* 




* 








• 

• 

4 


Class '2 . T ' 

• - - M ' 
NM 


no 
VO 

-08 

■ > 
12 


X)7 

-oV" 

15 


15 
35 
-03 


-15- 
-32. 
02 






* 








- 




* *• 


'I 


T Demo T 
M 
NM 


-23 
-02 


•01 
-12 • 

. 17 


06 
. 05 
06 


-12 
-16 
-07 


01 
-20 
23 






- 










0 


; 9 1 


T Psyl' T 

- M° 
.- - * NM 


08 ' 
01 


-15 ■ 
-00 ' 


11 

03 . 
15 


05 
04 
08 


-15 

-0'5 
-25 


-20 
-02 
-47 


J 
















T Psy 2 J 
M 

. NM 


— uo 
02 
-05 


-07 
01 

-10 - 


03 
-23 

22 


-10 
-08 
-12 


-04 
00 

-is, 


.21 
14 
30 


-02 
-46 

26 




> 


b 


• 








SProcl T 
M 
NM 


Al 

44 
37 


26 
27 
25 


-03 
08 
-15 


fr43 
48 
37 


-08 \ 

-04 

-12 


-31 
-51 
-04 


01 
01 

04 


■ -26 
-22 
-29 


I 

•< 




• 


1 






S Proc 2 T 

■ M 
NM 


-On 
rll 
06 


-01 
05 
-04 


-02 
-22 
18 


-08 
-13 
-01 


-10 ' 

07 
-^27 


04 

02* 

06 


07 
-09 
13. 


29 
38 
08 


08 
-12 
23 










/ V. 
• _ * 


T Proc 1 T 
M 
KM 


-on 
-08 

i6. 


18 
03 
38 


"08 . 
\l8 
-01 


13 
16 

ao 


-01 
-16 • 
17 


10 
■ 07 
19 


-07v 

•08\ 

-20 


r21 
-32 

^ 02 


, -03 
-01 
.-08' 


-43 
-49. 
-25 


t 


1 


• 




J Proc 2> T 


02 


02 


09 


01 


■ 08 


17 - 


-14 


45 


-21 


18 


• 06 
15 
19 








■ ■ M^" 
NM 


23 
-20 


11 
-02 


09 * 
■ '00 


09 
-08' 


27' 
-06 


-00 

42 


-30, 
-18 


36 
41 


-04 
-42 


01 
15 






* 


Climate. .T 
M • 
• NM 


16. 
06* 

'25 


17 
63 


21 
'l3 
41- 


11 
10 
12 


11 
f34 
'45 


-06 

-06' 

-05- 


-oi^ 

-02 


-39 
-34 . 
-32 


04 
29 
- -}7 


-40 

. -43 
*25 


22, 
31 
-04 


-3.3 
■ -20 

^26 






1. .-Di 
bs 

* 
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. points 
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3 are omitted, 
student PC's. 


See Appqndix E for similar table for largest sampl 
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Demo) is 51; for the, non-MAC OS group the .correlation is •>•. 04. The same 
* • co/relation for the total set of classes is -.31. . . 

" ' V • • ' ■ ■ 

, -. The following, based on Table .ni-7, are interpretations of each PC. ^ 



V • 



r 



• » \ 



'/ 



Input PrinciparComponents (PC's) / * ' , ^ 

pretest Achievement of Studehts. ^ • i 

Ach: generalized pre iichievement leveL The three Tibhieve^nent 
^ tests. STEP, tDT. and AP,. all load highly on this factor* . 

Pretest Attitudes of Studepts: " * • 

Att l! tolerant of ^mbigu'i|;y (CAPS-S)-,. rates unusual beliefs and 
^behaviors iffole positively (WA, WffB); tends to choose 
social stuclies over* other courses (SS Ch)*** 

Att 2; interest in complex problem solving (CAPS-2); thinks of »^ 
'^self as having creative ideas JCAPS-4). 

classroom Charaisteristics . * . . 

Ctess IV older, \Vhite, non-^oqr classes (age, percent ;vhlte, • 
percei\t not eligible for fre^ lunch). ^ ; , . . ' 

' Cl^ss^: larger;, younger,. homogeneous cl«8,ses,Aclass size, 

percek hot ESL, percent vvhite', percent Tiot'eligible for^ - ; 

free lunch, average age) . - ^ * 

'^Teacher Experience * * » 

4 T Demo ; more experienced teachers, althoL^^hjnot necessarily 
\^ with present^program. ^ , • - 

Teacher "Attitudes ^ ' ^ . - ^ 

, T Psy generalists; teadhers who tend to see many objectives as 
^ desirable^ not certain categorjes'as Critical.- \ 

/ T Psy 2; conservatives; teachers who score higher on ES VII / . ' 
traditionalism and TAW, and lower on fes VII progreseivisnS^ 

\ * ' . * ^ ' . ^ ' 

Proc ess/Climate Principal Components (PC's) . .r*' 

Proces5 Pated by Students . / 

S Prbc It generalized informality; no apparent emphasis on ^ 
^ ^particular types of activities, or on grades, from s,tudents* 
\ point of vieNy. . ^ - • 
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' S Proc 2; generalized traditional class; stress on grades, 
relatively little discussion or comparing; more 
- .-emphasis on remembering facts, in stiM^ents' 

J perceptions. **• . - 

Process as Rated by Teachers 
' T- Proc 1; emphasis on group activities and Higher order cognitive 

processes. • ^ , . 

-T Proc 2; emphasis on knowing, remembering, and individual work. 

— , , . . • - ^ , ■ t 

Classroom Climate as Bated by Students 

* . Climate ; students like the teacher and class. Correlates positively, 
,,j;to a limited extent, with Att 2, T Proc 1 and 2; negatively 
• * ^;/with T,Psy 2. 

Plots of thefdistributions of each PC were made for the total group of 

classes for which there were complete data for all variables and separately for 

MAeOS.and non-MAC OS" groups. Histograms of each PC for the total group are 

show^n in Appendix D. Most PC's show symmetric, normal-appearing distribu- 

tions for total sample and each, group. For. the total group, ahd for M>^COS and 

non-MAC OS groups, there is some, negative skewnessfor'T Demo. In effect, 

in both groups, years of teaching experience tend to lump toward the,iower end 

~ - ■ ■> • ' 

Of the distributions. Class 1 shows some bi-modality in both grov/ps, while 

' ' • ■■ ■ / 

Class 2 had three non-MAC OS classes that were off to the low end of the distri- 
bution, producing negative skewness for that PC for non-MACps and total group. 
-There was some negative skewness in S-Proc 2, "and positiv^ skewness f ^r T Proc 2 
for the non-MACOS distributions, with only slight effect op the overall distri- 

f 

butions, as ca^ be seen from J;he histogram in Appendix £). Normal plots and 
cumulative ogives, not shown, indicated essentially whapan be,seen'in the histo- 

'* ^ I 

gram; viz. , most of the PC's have reasonably symmetrical distributions that 
appear normal,, and do not show outliers. The disti/ibutions of PC's were considered 



reassuring for use in subsequent analyses,, although it may be noted that nor- 
mality is not a necessary assumption for tests of differences betweea,groups of 
approximately equal size and equal variances. Table JII-9 gives descriptive 
statistics for the PC's for MAG OS, non-MACOS, and the total group. 
. 2. Initial Comparabrlityof Groups . ^ 

A question of interest is whether the two groups were comparable 

initially. A multivariate analysis of variance was made to compare the MACOS 

, - - ^ I 

and hon-MAGOS classes. with respect to the input PG's^ 

•Two separate analyses were made. The first used only student-based 
PC*s (derived from class means, not individual students), with resulting samples 

of 55 MAGOS classes and 47 non-MACOS classes.^ The PG's were pretest 

<? ' ' ' - 

jt ^ ■ ' 

achievement and attitude, and classrooni characteristics (Ach, Att 1, Att 2, 

Class 1, and Class .2). The second anajysis^ included, in addition, 3 teacher 

PC'S pertaining to experience and attitudes (T Demo, T Psy 1, and T Psy 2). 

This analysis had sample sizes of 47 MACOS and 41 non-MACOS classes. 

Neither analysis produced a significant difference between the groups. 

For th§ comparison using only the' student PC's , F5 gg =.63X P 68,'While for 

the comparison using both student and teacher PC's, 79=. 287, p ^ . 98. It 

appeared that the groups could be considered as no^ different at the outset with 

. 8. The program used was the Multivariate Analysis of Variance Program 
,of the Biometric Laboratory, University of Miami. 

9. The analysis described here did npt include 4 ciasses from a district 
that did not participate in the follow-ups, plus an additional 2 classes 
for which there was missing STEP data, either pre or post. The 
classes in the district that were not included here were included in 
other analyses to be dcscril;)ed later. 
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Table III-9 

MeansrSfandard-nejQations (SD), Skewness (Sk) 
Kurtosis (K), and P^ngTp fdrTC's.by^Grouj)]/ 













MAC OS 








* Noh' 


-MAC OS 






- 


PC 


Me^n 


SD 


Sk 


K. 


Range 


Mean 


ou . 


OK 








1. 


Achl 


.12 


1.51 


.23 • 


-. 57 


-3.4-3.0 . 


. 01 








— ^.y —0. u ^ 




2. 


Attl 


.12 


1.28 


-. 08 


-.96 


-2.3-2. 7. 


-. 06 


1.49 


-. 20 


-. 42 ' 


— «}. u— ^. 0 




3. 


Att2 


04 


1.07 


.24 


-1.26 


. -1.7-2.0 


. 20 . 


. 1. 03 


net 
. Ob 


. 55 


_9 1 1 
— ^. x^o. X 




4. 


Class 1 


.05 


1.59 


■ -. 59 


. -,56 


-3. 7-2.4 


-. 00 


1. 58 


A A 


" 22 


— U— ^. 0 




5. 


Class 2 


. 26 


1. 14 




. 2o 


— ^. o— o. D 




. 1 51 


-2. 72 


10 52 


-6.. 9-1. 8 




6. 


T Demo 


■p. 02 


1.31 


1.53 


2.79 


-1.5-4. 7 


.04 


1. 20 ■ ^ 


.40 . 


■ 1..02. ■ 


-1.5-2.6 . 




7. 


T Psy 1 


-. 58 


. 2.03 


.37 ■ 


.17 


-5.3-4.4 


;31 


2.02 


-.21 


-. 88 « 


-3. 6-3. 7 . 




8." 


T Psy 2 


-3.1 


1.12 


.34 . 


-.67 


. -2.3-2.4 . 


.45 


1. 55 


-. 47 


-.13 


-3.6-3.6 




9. 


S Proc 1 


.14 


1.75 


.03 


' 66 


-3. 8-3. 5 


-.01 


1.84 


-. 12 


. .18 


-4. 2-4. 3 




10. 


S Proc 2 


-.41 


i.66 


-.84 


1.27 


. -6.1-2.2 


.59. ■ 


i.58 • 


.76 


-. 43 


-1. 2-4. 5 


a 


. 11. 


T Proc 1 


...49 


. 1.88 . 


-.16 . 


-1.18 


-3.2-3.5 . 


, -.28 


1.45 


-. 09 


-.74 


-2. 2-2. 2 




12. 


T Proc 2 


-.60 


1.38 


-. 10 


-.46 


-3. 8-2! 2. 




- 1.36 


-.04 


-.71, 


-2. 6-2. 8 




13: 


Climate 


.44 .' 


1.38 


.39\ 


-.'36 


7I.9-3.9 


64 


.1.69 


.07 


-:.96 ' 


-4. 0-2. 8 





PC 


Mean 


• SD 


< TUlALiUKUUi' 

■ - Sk . K. 


Range . , 




1. 


Ach 1 


. 00 


1.52 


.00 


• -.89 


-3. 38-3. 02 




2. 


Att 1 


-.02 


1.-37 


-.10 


-.73 


-2.98-2.72 




3. 


Att? 


.06 


1.06 


.18 , 


-.54 


-2.06''-3.09 




4. 


Class 1 


T. 04 


1.57 


■ -.43^ 


-.47 


-4. 00-2. 84 




5. 


Class 2 


.18 


1.31 


-1.50^"' 


8.16 


-6.87-3.46 




6. 


T Demo 


-.01 


. i.24 


1.14 


1.58^ 


-1.54-4.72 




7.- 


T Psy 1. . 


-. 07 


■ 2. 14 


.21 


-. 28. 


-5. 25-5. 51 




8. 


T Psy 2 


.04 


1.34 


.03 . 


-. 29. 


-3.56-3.45 ■ 




9. 


S Proc 1 


^.01 


.•1.79 


.02 .. 


-.42 


-4.23-4.28 




10. 


S Proc 2 


' . 0.3 - 


1.67 


-.20 • 


1.41. 


-6.09-^.45 




11. 


T Proc 1 


,. 04 


1.78 


. .03 


-.90 


-3.71-3.51 




12. 


T Proc 2 


-.04 


1.49 


^ -.05 


-.44 


-3.77-2.82 




13. 


Climate 


-.02 


• 1.58 


' -.04 


-.29\ 


-4. 0.3-3. 86 


f 




1. Sample sizes are: MACOS, 45; non-MACOS, 36. 
data, tncluding postt^st and follovv-up measures. 



These are samples for which^^re were complete teacher and student 
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with respect to the array of these composite variables (PC's) of student pre- 
test.classroom and teacher characteristics. 

Noumally ofte would not make a further examination of the significance 
of individual variables if the overall multivariate test is not significant. That 
practice, to protect the Type I error rate, has typically been followed In this % 
study. VJhat follows is a departure from that principle, undertaken because of 
continuing interest in the nature o'f the two npn-experimentally formed groups 
otclass es Table III-IO gives the means and standard deviations of the student 
and^lassroom PC's for each group, .the difference between means, and the F- 
statistic anj3 p-yalue of the univariate test of difference for each PC.1<^ It may 
be seen-in Table III-IO that none, of the student pretest and classroom charac- 



teristics^^PC'd^ reaches significance on a univariate basis. 

* ^ ... 

Table III-ll gives the same statistics for the univariate "analyses of . 

differences that include^the teachers PC's as well as the student and class ones. 

"ft 

As before,' none of the.student or class PC's reaches significance. However, 

"the second teacher attitude principal component (T^Psy 2) was significant at the 

.05 level (p .013), and the first teacher attitude PC was nearly sO (j^ . 058). 

The. original variables that correlated strongly with the T Psy 2 component were 

the Educational Scale VII Traditionalism score and the Teachers at Work (TAW) 

10. It will be recalled that the pretest means and. standard deviations for 
. the individual variables that were combined in the principal component 
- composites were presented, earlier in Tables III-4, 5, and 6. Tests 
of significance of "differences of the individual variables vi^re not given 
' for the reason that it was believed to be methodologically more sound 
to make an over-all multivariate test with as much power as possible 
before attempting to interpret a test of each of a large number of variabl 
separately. . • - • . 
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' ' '■• Tab^e III-IO . 

Means, Standatd^Deviations, N's Differences / 
• • ■ -Between Mea.ns... and Values of Univariate ^'-tests - 
(df 1, 100) Between MAC OS and Non-MAC OS Classes 
■/•"f . Adjusted for 5 Pretest and Classroom PC's 



Principal 
Component(PC) 
Pre-Achievement 
■ Ach 

Pre-Attitude 

^ Attl'-'" ' • 
Att 2 

Classroom 
Characteristics 
; Class 1 
, Class 2 



- o MAC OS ■ 
Mean SD ii. 

.07 ■ 1. 60 55 



• . 11 1. 26° 
-.Olv 1.06 



\ Non-MAC 06 

Mean. ^ SD. N 

-.11 1.60 47 

\. 47 
47 



55 
55 



-.17 
.10 



1.63 
1.12 



-.01 
.17 



1.59 
1.21 



55 
55 



-. 00 
-.17 



1.60 
1.68 



■47 
■47 



\ ; ■ . • • \ 
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Table ni-11 
Means, Standard Deviations, N's. Differences 
Between Means, and'P-Values of Univariate F-tests 
(df 1, 86) of Differences Between Means of MAC OS 
and Non-MACOS for 5 Student Based and 3 Teacher- 
Based Background PC's 







MAC OS 






Non-MACOS 




Difference 


P— 




Mean 


SD 


XT 

N 


Mean 










Pre-A<5hievement 


















Ach 


'.10 


lT48 , 


47. 


-.11 


.' 1.53 


41 


.21 


.503 


Pre-Attitude 


















Att 1 


i' .09 ■ 


1.26 


■ 46 


-. 23 


.1.-49 


'41. 


.34 


.284 


"Att 2 


-. 04 


1.05 


46 


.14- 


1.06 


41 


-.18 


.439 


'classroom 






r 


> 










Characteristics 


















Class 1 \ 


. .-.01 ■ 


1.58 


47 


-. 04 


1. 53 . 


41 


.03 


.928 


Class 2 


• '.26 


1.15 


47- ■ 


.06' 


1.49 


41 


.20 


'.'465 


Teacher 


















Characteristics' 


















T Demo, . 


-.08 


1.31 


47 


.15 


1.42 


41 


-.23 . . 


.440 


. T Psy 1 


-.47 


"2. 18 . 


47 


.39 


2. 02 


'4:1 


. -.86 


.058 


T Psy 2 


-.32 


1.11 


47 


.39 


- 1.49 


41 - 


-.71 


.013 . 



4a. 
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score* Oa both measures, non-MACOS teachers on the average scored 
significantly higher (ar the ;05 level)" than MAC OS teachers; i. e. , in the 
direction of traditionalism. The variables that correlated particularly well 

' with the first teacher attitude^omponent (T Psy 1) were summated ratings 

> 

of the importance of different categories of objectives. There were three 
"^categories for which there were significant differences 




non-MACOS teachers',- on the average. Those were/ Category 2 (objectives 

* I 

intended to be related to a crosa disciplinary, humanities, integrated concept)!"^ 
Cat^ory 3 (objectives intended to be related to Jnfluirjr modes and processes); 
and Category 4 (objectives intended to be related to self-actualization as a 
goal of instruction). MACOS teachers, on the average, rated thqi^e groups 
of objectives more positively (as being important) than non-MA^doS les^chers. 
Thus there is indication that the two groups of tqachers were different withx <^ 

, ■ !-\ ■;■ . 

respect to certain attitude .variables. There ik no indication th&t the classes 
of students in the two groups were significantly different 3vith respect to certain 
preach ievement and pre-attitude variables. -There" is no indication that the 
classes of students in the two groups were significantly different, with respect 
to classroom demographic characteristics, using PC's as mnasures. 

.Subsequent analyses of covariance arid regression analyses will 
statistically remove initial differences, although they pay remove some 
treatment effect as welL In light of possible initial differences between the 
groups of teachers, homogeneity of regression tests of outcomes on inputs 
become particularly important; such tests and their, results are described 
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b'elow^l^ Furthermorot caution is needed in interpretations of results and in 
formulating hypothcfkes about possible causes of effects. With respect to the ^ 

-A ♦ 

latter, it is restated here that material obtained from interviews with students 

and teachers and presented in Section V is considered to be an Important soutce 

of information bearing on po^^le explanatory hypotheses. ' , " 

J 3. Major Outcomes . . ^ 

"a. Dependent Variables * ' . . 

Dependent variables are organized according to whether they were first 

year outcomes (posttest), FoUdw-up 1 outcomes (FU-1) or Follow-up 2 outcomes 

(FU-2). Pqsttegtj nieasures were:-^^ 

AP: a MACOS course content specific test ' - * 

' ' ' ' 

IDT: the Interpretation of Data .Test* (interpretation and use of 
u , ethnographic data) 

STEP: STEP Social Studies Test (social studies skills and knowledge) 

SS Ch: social studies choices; the number of times social studies 
was picked in preference to 5 other subjects 

& WA; What Would You Think, Part A, attitudes toward unusuaL 

behavior, customs or beliefs - , 

WB: What Would You Think, Part B; attitudes towards people who 
might do such things or have such customs or beliefs - 

Ci\PS Ij ratings of ability of self as problem" solver' 

CAPS 2: ratings of interest in solving problems 

CAPS 3: ratings tolerance of ambiguity in problems 



11. To anticipate, the results were that the hypothesis of homogeneity of 

regression of outcome variables on teacher coniposite variables were 
accepted at the . 05 level. 

12. AH outcome variables are based on class means. 

• . : " " \ ^ ; • ' 
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CAPS 4: ratings of creativity of self thinker 
Pol low-up 1 measures were: . • 

Skills: the average of ratings of 8 scales which for each \ H 
item, range from i-learned how to do this last year ' « . 
and found it a great, ad vantage this year, to 5-dldn*t 
'learn. how to do it and wish I had because it would help . , 
in social studies this year* ' ' ^ 

Know: the average of ratings of 7 scales pertaining to knowledge 
- - of topics that may have been studied last year; same 

c'scale values as for skills (i. e. » values- ranged from 1-learned 
' this last year and found it a great advantage this ye^to 
5-didnU learn this and wish I had because it \yould help^ 
^ \ in social irtudies this year)!^ ' s « 

Interest: responses .on t^h point scale to the question of how" 

interesting you fiud social studies this year compared 
to last year; 1 is a lot more, 5 is a lot less.^'^ 

Follow-tip 2, measures were: ^ • ^ 

SS Ch F: 6 pair comparisons of social^ studies, arithmetic,, science 
English, scored for number of times social studies was 
picked (0 to 3)16. ' • 



.13. My Social Studies Class This Year and Last (MSSCTYL), Part III, items 
1-8,. The items'were: 1) how to make or use maps; 2) how to make or * 
use graphs; 3) how to find information in the library; 4) how to write ^ 
. reports; 5) how to tell the difference between facts and opinions; 6) how 
to support your idoas or opitfions with evidence or facts; 7) how to work 
with other siadents in small groups; 8) how to lobk at all sid^s 9f a ques- 
tion before deciding what you think. See Appendix. A . / - ' 

/ ^ • . - ' • 

14. Ibid. , items 9-15. The items were: 1) how peopI<> and fheir environment 

' affect each other; 2) the history and/or customs of our country; 3) the 
history and/or customs of other countries; 4) different belief^ people 
have; 5) how different animals behave und Svhy they behave the way they 
do; 6) similarities and differences in ways a^nimals and people behave; 

. . 7^ learning and understanding more about myself and other people. See 
Appendix a ^ \ ' 

15'- Ibi d. , Part II, 'item 3i;' 

16 ! This was a recodification of SS Ch to take into account the fact that 7th 
grade programs do not normally include reading arid spelling. 

• ■ - - • ■ ' • , ' rc_. ^ ■ 
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WAF: same as WA 
WffBT: same as WB 



.\^WAPF: two\^WA-type Items concerning attitudes toward unusual 
> t behavior of a hypothetical peer - - 

WffBPF: attitudes toward the peisonythat might behave In this 
' . . unusual manner / a * . * ' 

AP1-4F: the man and -other animals part of the MACQS spjeclfic 
quest lonna Ir^AP) 

SS: rn absolute rating' on a 4 point scale of how much social studies 

. is liked this year; 1 - dislike very much; 4- like very much; 
• ♦ 

b. Multivariate Comparisons and Analyses \ . 

With 20 outcome or dependent variables, one might expect; by chance 
alone to find significant differences at the . 05 level in one or^two cases if each 
variable was tested individually, assuming independence of variables. As a 
means of guarding against that possibility, a multivariate analysis of cbvariance 
^as made. The independent variable was Group (MACOS, non-MACOS); tjie 
coVariates were tne iriputj_ process and climate PC^s. AH 20 outcome Variables 



were used simultaneously as dependenj; variables. 



Two analyi^es were made. The first used only^the 8 student based PC's 

■ \ ' ' "/ ^ " ' 

as covariat^s (pretest acjiievement, attitude, classroom characteristics^ 

.» * \ " - ■ . ' ^ ■ 

student based ratings of processes and classroom climate). Tliis provided 
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sample size with complete data of 97 (54 MACOS and 43 non-MACOS classes) 

t_ \ > • V 

17. The program used was again the Multivariate Analysis of Variance 

/ Program of\he Biometric Laboratory, University of Miami. ' 

IS-t By including follow-up measures in the analyses of classes, 4 classes 
Y from 1 district that did not participate in the follow-ups were lost. 
VThe other 7 losses from the 1-d^classes were also mostly froni follow-ups 

except for 2 cases for whitfh ther^ was missing STEP data, either pre 

♦ • \ . .- < , 

■ 'or ppst. \ . ■ . 
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The secbnd Included, in addition, tjie 5 teacher based PC's (teacher experlctoce, 
attitudes, and ratings of procejsses). The sample^sizes for the second analysis 
were 45 l^COS and 36 non^fMACOS claases, or a total of 81 classes. The 
ratlonale underlylpg these two analyses was as follows* The analysis^ using 
only/the student-based PC's gives the maximu^a sample sizes having cbmptete , 
-data sets and thus involves'the samples of most general interest with respect 
tq^ outcomes. It also ininimizes the number of cqvariate8,*_It adjusts outcome 



^eans statistically for differences between groups that might have been asso-,^ 

r •■ . ■ ^ • ' ■ . . , ■ - . ' . 

ciated with pretest characteristics of classes, average perceptions of class 
activities or processes, ^and average4)erceptions of classrobm climate* Any 
or all of fheae may be relate^, to curriculum, ahd to the effects of curriculum. 
Thus, tHe analysis 'essentialiy^^addresses the question of whether, by equating 
statistically for differences in potential operational and mediating character is- 
ties of courses as p^rcciVe^^y tlie classes of students, as well as in i^nitial 
characteristics, there is still reason to believe there are differences between 
the two groups with respect to the total s^ of outJomes under consideration. • 
That is/ the analysis tests the hull hypothesis that the MACOS antfnbn-MACOS 
groups of classeslvere not'differejat with respect to an array of outcome vari- 
pi^ables, when those outcomes were statistically adjusted for input and' intervening 
characteristics. The reasons.for doing the second analysis with the teadher 

- PC's included were to examine the possiblity that differences in teacher cfiarac- 

' ■ ^ ^ ' . " 

teristics may have influenced observed^ multivariate differences', if any, bet)A^een 

groups, and to establish characteristics of the samples for which subsequent invest^- 



gatioos of relationships of variables, inoluding teacher variables, were of 
Interest . It should be noted. that In both'casea/ the analyse^ t^ddtessHhe ' ' . 
question of differences hi outcomes associated with groups, notV>f possible 
relationships among variables within or between ^groups that may help explain 

. differences, thp latter.Wlll be addres^sed Jn subsequent analyse?^* 

> ' ' M' * ' 

the results for both^nnalyses showed^a sknificant difference between : 

• ' ' ' • ' 19 ' 

groups for the multivariate F-test, (pC* 001 in both cases). Table in-12 

gives the p-values of the univariate tests lof feach outcom^, v^lable adjusted 

for the 8 student PC's and, In addition/ for the 5 teacher PC.'s, Adjusted and 

— unadjusted means, -8 tan^li^^dev^J^tl^ and differences between the MACOS 

and non-MACOS groupa will be presented following a statement about homo- 

genelty of regression tests made of each variable. At this point, the results 

support the hypothesis that the two groups differ when all outcome variables 

taken together are adjusted statistically for student (and student and teacher) 

background, classroom process or activities, and classroom climate variables. 

The univariate tests of adjusted outcome vaVjables point to at le^st s^x .outcome 

* ' > •* ■ . ' " J * * 

variables in posttest and* in eacji follow-up in which there is indication of . 

V ^ • 

interpretable differences between groups. ' " \ 

^ ^ Homo peneitv of Regressions Tests . . ^ ^ ' 

Homogeneity'of regression tests of each outcome variable were made ^• 
' . ' ' . ' , . '.V . ■■" ' -r.' ' 

for each case ,the large group and the reduced group). The available program 

19, For the.analysis usin^the jB studenc-based covarlates, F20,68=3»68r, 
- * * p^.OOl^ For the analysis using afl 13 covariates; F20,4f^ 3. 215* p-d,.a01v 



III-40' 



" • 'Table nM2 
P- Values of Univariate F-tests of Differefeces 

Between MAC06 anB Non-TMAGCis Classes on 20 

Posttest. and Follow-up Outcomp Variables ' 
Adjusted. for 8 Studek«'PC's, ahd for 13 Student • 
• and Teacher PC '5. ' •" 



Period ' 
Posttes^^ 



Outcome 
Variable 



AP 

" ' STEP ■ 

IDT 
■ * SS Ch 
WA 
. WB 
CAPS-1 
CAPS-2 
CAPS-3^ 
CAPS-4 
Follow-up 1 Skills 
^ ' Know 
' Interest 
Follow-up 2^ Af»l-4F 
\ ' SS Ch F 
SS 

. WWAF * 
WBF . 
' ■ ' WAPF.. 

, ^^VBPF 



P- Values for F-tests (df =fl, 87) 
JJa^ng 8 Student PC's as Covarlates* 
(MAC 06 n'>= 54; Non->MAOb6 N = 43) 



.001**^ 

.277 

.346 

.497 

:079 ' 

.595. 

.064 ^ 

■ . 619 

.103- 
..046* 

.OU* 

.0,13* 

.002** 

.293 

.4'59 

.296 

.030* 

.423 

.504 ■ 



\ 



P-Values for F-tests (df = 1, 66) 
Using 13 Student and Teacher • 
PC's as^Covarlates , * ' 
(MAC06 N='45^'Non-MAC06 N = 36) 
.001***- 

* V • ^* • 528 

I ■ . -.605 . , ' 

{ • .916 
. .018* 

., ■ .412 . *■ - • • 

) .(f63 ♦ ' . • 

' -^.411 

.895 ^ - . » 
.446 ** 
' " ;115 . « 

r . 009** ■ , 

- *.P56 . ^ - 

* ■ .029*. 

.600 '• 
.581 

\ .-.978 

..318 ' . 

■ . ^.235. 

- ■ . 940. ' . 



*p 05 
**PT<.01 
***p-i.001 



. / 



Note: these designations nre made as a visual aid to the reader, since subsequent 
reference will be made especially to outcome variables with p-valueS of .05 

or less.' , , C . 

* - - • » ■ . <i 
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could not handle 13.covariates simultaneously.^O ^ Therefore, the homogeneity 
tests were made separately for the 8 student-based PC;s an^I the 5 teacher- 
based PC's. These analyses in both cases involved again listwise deletion, but 
for the specific variables involved in a given analysis. That is, each class* was 
included for a variable if there were data for the class on the particular outcome 

' ' - ^ ' - ^ 'i 

and particular set of PC variables rather than dropping the whole class if there 

' , ' . V \ 

were any data missing on any other PC or outcome variable. Thus, the sample 



slzW ranged from 97 to 102 for different analyses. \For the iffeduced group, ^he ^ 
homogeneity tests were made only for the 81 cases for which there were complete 
data for teachers and students. The reason for that was further analyses including 

V 

teacher variables were to be made of that set of classes, and thus an analysis of 
homogeneity of regression specifically for that set was wanted. 

. For the total group, using the 8 student-based PC»s,^^ there were 

two outcome variables for which the F-test for homogeneity of regression was 

- • 22 

significat at the .05 levef: \\^^A (posttest) and \IWAPF (Follow-up 2). 

In order to assess which covariato or covariates were associated with non-homo- 

geneity of regression, the homogeneity tests were redone for the two outcome 

variables for each covariate. When WWA was regressed on each PC individually, 

all regression slopes were homogeneous except for Climate. For ^\^'APF, 

there were interactions fdr ACH, Class 1,~S Pro6 1, S Proc 2, Climate 



20. One Dimensional Analysis of Covariance with Homogeneity of Regression 
Test, prepared by Dr. C. Mitchell Dayton, College of Education," 
University of Maryland. . ^ 

21. Ach, Att 1, Att 2, Class 1, Class 2, S Proc 1, S Proc 2, Climate. 

22. The. F-test for among-slope differe'nces for W^^h was Fs, 84'' 2.121 
p-i...042 and for WAPF, go"^' Group sizes for 

- posttest variables were MACOS = 55; non-MACOS = 44. 
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Results of homogeneity of regression tests for the 8 student -based 

' 1^ - • ^ ■ " ^ \ 

PC!s for the.reduced group of classes were that there was non-homogeneity 

«w ^ 

of regression. for WWA, WB,' WAPF and WBPF. Again, analyses for 
individual PC's indicated that for al^except WAPF, Climate was the only 
variable for which there was hieterpgeneity^ When the 5 teacher PC's (T Demo, 
T Psy 1, T Psy 2, T Proc Ij jl Proc 2 ) were used to test homogeneity of re- 
gression for each outcome variable, all regressions were homogeneous. These 
tests, of course, could onlj^be done with.the reduced group since that was the 
group with complete teacher data. - - ' ^ 

The regression lines of ^\WA and W\YB regressed on Climate for the 



two groups are givea^in figures III-l, 2 , 3 and 4. These plots show the regions 



orsigraficaiine and non-significance of difference between the slopes as determined 

/ ' _ / ^ ' " . - ' ' " 

by the Johnson c.nd Neyman technique, based on 95% confidence limits around the 

difference between regression lines. Each figure also includes for each group, 

i 

the unadjusted and adjusted means and standard deviations of the outcome vari- 
ables,' and the, regression intercept, slope, and standard error of the slope (SEb). 
Figure KI-l sh\)ws ^he regression lines of \\WA for MAC OS and non-MACOS classes 
for the total sampl^ of classes (N^^ 108). Figure III-2 shows thelines for the 
same variable fox: fche reduced groups of classes { N = 81). Figures III -3 and 4-show 
the regression lines for^:i\^'B (posttest) and WWBF (Follow-up 2) for the rVOuced 
group of MACOS arid npn-MAC"OS classej, since only in those samples were the 



23. ' F-test p-vkiuies with 8 and 63 degrees of freedom were: WWAj p <u. 025; 
WWB, p ^.024; WBF, p 048; WAPF, p^ .000; WBPF, -H.043. 

24, Johnson, ^T. O. , and Jackson, R.W.B., Modern Statistical Methods . 
\^ ' • Chicago: ^iand McNaily, 1959. 
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Figure III-l 

Neyman-Johnson Regions of Significance Between 
MAC OS and Nqn-MACOS^ Egression Lines for WA 
Regressed on the Climate PC (total sample) 
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Figure III-2 . • / 

Neymanr Johns on Regions of Significance Between 
MAC OS and Non-MAGOS iR^ression Lines fo^^\^'A 
Regressed on the Climate EG (reduced Sample) 
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Figure 111-3 •„ 
Ney man- Johns on Regions of Significance Between 
MAC OS and Non-MACOS Regression Lines for»WB 
R^ressed on the Climate PC « 
(reduced samp.le) 
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Figure 111-4 

Neyman-Johnson Regions of Slgalflcance Between 
MACds and Non-MACOS Regression Lines for Wh'BF 
Regressed on the Climate PC 
(reduced sample) 
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tests of heterogeneity significant with respect to Climate. 25 

Figures Ul-i and 2 show for WA. that both for the total sample of 
.classes (Figure m-1) and the reduced sample ^Figure III-2), there is an 
interaction with respect to classes that rated classroom climate ^s poor 
(the negative end of the Climate PC scale). MACOS classes in that -ange rated 
unusual customs or beliefs more favorably on posttest, even if they had rated 
classroom olimatelower in midtest 2 than non-MACOS ciasses%jrhere is 
indication.of the opposite being the case at the upper end of the C l|kate-range 
for WA in the reduced sample (Figure HI- 2). That may be the result of a 
change in sample characteristics owing to lops of classes .in the reduced sam- 
pie, although except for the MACC36 regression slope s, the other parameters 
of WA for the two groups are essentially the same in the reduced sample 
as in the total sample. Generally, the slope for the MACOS classes is flat _ 
or negative. The slope is not significant for the full sample (the 95rconfi- 
- dence limits include zero); it is just significatit in the reduced ^mple. ^The 
slope for the non-MACOS classes is positive in all cases, and significant ^xc^ 
for WB for the reduced group. The' implication is that C limate bore little ' 
or no relationship t\how MACOS classes rated WWA or.B items, \yhile there , 

A ■ ' ■ ' • 'I • 

did seem tp Be some positive relationship between ratings of classroom dl-mate 
variables arid ratings of customs ^nd of people who hold them in the non-MACOS 
classes. - > ^. 



25. The apparent.slopes of the.regression lines shown in the figures are 
exaggerjpted by the scaling of the Y-axis relative to the X-axis. 
Also, boundaries of regions of significance are not drawn to exact 
values on the x-axis. • , 

• " r • 
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Figure in-3 presents an interesting situation.. Climate wias.-the one 



variable in the set of variables that contributed most to the significance of 
heterogeneity for, the group slopes. However, that variable fier se was not 
• significant at the .05 level. (the p-value of the F statistic was .075). The plbr 
of regions of significance indicates that there was not a significant difference 
of regression slopes of WB on Climate over the range of the climate variable. 
Therefore, one may conclude that while collectively the set of PC's produced 
a heterogeneity of the regression.hyperplanes, and w^ileClimate was the likely 



' candidate for accounting for the non-homogeneity, it^er^^ontributed more_ 
than any of "the other covaf iates", but not significantly, to th6 overall heterogeneity. 

. . . ■ . ■ . . 



The overall cpnclusion*|sj 



hat there is reason to consider interactions 
of Qlimate and WA (posttest) resf^onses between" groups-^- For WB posttest 
and F0II0W-U& 2 in the reduced sample, classroom Climate may have different 
effects in the two main groups (MAGOS,' non-MAC OS). Figure\III-4,for W^^'BF, 



again suggests a,different effect ofClimate between the two groiips on ratings of 

V \ ' ■ 

people who might have unusual beliefs or custpms. However, Climate in the non- 

\ - . .-^ . 

MACOS groug^ is associated with more negative ratings. Both f6r WB and WBF, 



the MAC OS regression slopes are not significant while the non-M^^COS ones are. 
With respect to WWAPF, there appears to be a complex interaction based on 
several factors. Johnson and Neyman confidence intervals and regions of.slgni- 

' ^.ficancje were computed for each PC for which there.was heterogenei^ty of regres- 
sion, ^although they are not presented he^e. The position taken is thai interpreta- 

■ tions of differences between groups for this variable is complex at b6st, and that 



III-49 



little femphasis or weight should be put on those two measures. They.are 
included in other analyses, but not interpreted. The consequences' of hetero- 
geneity of regression- for WA and WB are more 'important j^ithin the overall 
context of tlfe study. , » . . . 

" ,The overall importance of the analyses of homogeneity of regressions 
of dependent variables on the various covariates that, with the exception* of 
the attitudes towards customs and people measures».^there do not appear to be 
interactions between groups. Thus, Analysis of covariance is supported as an 
analytic strategy,as is the use oi fixed-order, stagewise regression. 

. As a final step in examining the nature of distributions of adjusted out- 
comes, residuals (observed minus expected values) of each outcome were com- 
puted using the 8 student -based PC's as predictors. Scatter-plots of standardized 
residuals plotted against standardized predicted dependent variables for the 

> 

total groups were examined. They are shown in AppendixC . Examination' 
of the scatter plots suggest that there were no unusual patterns in the swarms ^ 
of the different variables nor were there more extreme values than.would be 
.expected by chance. .The same plots for MAC OS and nori-MACOS classes were 
made, with similar results. It was believed that distributions of residuals would 
not seriously bias further analyses. 

Several conclusions were drawn from all these analyses. There were 
differences in outcomes between the two groups .of clpsses (MACOS, tion-MACOS)' 
when they were adjusted for student, or s<^udent and teacher, input, process and 
clintate variables, and when aU'outcome variables were analyzed simultaneously. 
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^The assumption that regressions of^utcome vaj?iable"s on the PC's for the 
two groups were homogeneous was supportjBa for the majority of variables in 
the large and reduced samples. Wh^ the assumption of homogeneity of re- 

!^'fbr WA (and also for WWA, ^^'^^'BF, and 
T^'WB^ThHhexedueed'sample), It was found that the one covarlate associated 
with non-homogeneity b^ween groups'was "climate. The variable WAPF showed 

interactions between groups on a number of predictors. . ' 

* ' '• . • ^ , ♦ 

2) Attelyses of Differences . • . , 

On what outcome variables were there differences between MAGOS 
and non-MACOS classes^ Table ni-13 and III-14 summarize the unadjusted and 
adjusted means, standard deviations, differences (and p-^valUe of the F-statistlc) 
for each outcome variable, for the largest possible group of classes with all 
variables' for a given (^tcome. These tables were obtained from the analyses . 
of covarlance described above. Table 1^-15 and III-16 give the same information 
for the reduced group. I In this case, the analyses wefe held just to the 81 classes 

with complete sets of data in order to provide a comparable summary 

specifically based on the sub-sample Including all teacher variables on which 

subsequent analyses were planned. . « ' . 

Table III-13 shows that when no adjustment in standardized outcome 

means for the largest group was made, there were outcome differences in: 

' * ,AP, the MACOS course content specific test, with MACdS 
classes outscoring non-MACOS classes on posttest, on the 
^ average, and- also AP1-4F, the Man.and Animals part of 

AP, in Follow-up 2, a year later; 



Table nt-13 

Unadjusted Outcome Means, Standard Deviations, Differences 
and-P-Values of Outcome Variables (z-score form)- 



Outcome 




MAC OS 




\ 


Non-MACOS 


iJllf— 




I'l'I lUli 


y ilk i«it/ic • 


moan 


bU 


VT 

N 


Mcnn 


Oil 




P 


1st Year 


AP 


.38 


.96. 


1 

55 


-.46 


.32 


' . 47 


. 84*** 


.000 


(Posttest) • 


STEP 


.01 


1.03 


55 ' 


, -.05 


.94, 


47 


.06 ■ 


.758 




IDT 


.10 


.99 


55 


' -.15 


..98 


. 47 


; 25 


.197 , 




SS Ch 


.12 


.89 


55 


-.20 


.•9B 


47 


.32 


.079. 




WA 


.18 . 


.92 


55 


24 


1.06 . 


47 


i42* 


.036 




wfm 


.17 


.90 


55 


-.18 


1.05 


47 


.35 . 


.067 




CAPS-1 


-.15 


1.04 


55 


. 21^ 


.96 


,47 


-. 36 


.074 




CAPS-2 


.12 


1.13^ 


•55 


06 


.82 


. ■ 47 . 


.18 . 


.376 




CAPS-s' 


.07 


1.06 


55 


-.16 


.95 


47 


.24 


.242 




CAPS-4 


.04 


.91 


55 


-.05 


1.10 


47, 


.09 


.643 






.15 


1.08 


54 


-.15 


. oo 


44 


.-30' ^ 


.138. 




Know. 


29 


.90 


54 


.30 


1.07 


44 


-. 59f * 


.00^ 




Interest 


. liv 








.92 


44 ■ . 




.000 


FoU6w-up 2 


APl-4 F 


.22 


.91 


54 


-.'28 


•1.02 


44 


. 50* 


.012 


SS'Ch F • 


-.07 


.99 


54 


.09 


1^03 


43 


r.l6 


.456 


















"7958- 




SS 


-.04 


.91 


54' 


-. 03 


1. 15 . 




-..01 


\- 


WWAF ' 


.08 


.95 • 


54 


-.11 


1.08 


•' 44 




.351 


WWBF 


.14, 


.85 


54. 


-. 23 


1.13 


44 

0 


% 


.071 




WAPF 


.06 


.94 


54 


-.09 


1.14 


44 


.15 


.480 




WWBPF 


.03 


»93 

1 


' 54 


-.11 - 


1.14 


44 


.14 


.499 

V 



*p^.05 Note: Even though al|p-values are given, differences xVith p-values aC 
**ps-01 - . 05 or less are designated with asterisks as a.visual aid to readxjrs 

***pi.001 " in Identifying variables of particufar interest/ 

' ) * * • « ' / ' 

1. PC's used ^vere student based: Ach, Att 1, Att 2, Class 1, Class 2, S Proc 1, S Proc 2,- 
and Climate. Outcome variable z scores, are based on total group means^ for which there 
were outcome variables (N*s =i. 102-196) * 

f 

2, The test of the difference is the F-test. 
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Table m-14 

Means, Standard Deviations, Differences and P Values 
of Outcome Variables (z score form) Adjusted 
for 8 Input,Process/CIlmate PG'sy 



5- 



Outcome 

Vari:ihlo 



Mcnn I 



MAC 06 

SD ' 



Mean 



Non-MACdS 
SD 



Diff^Ap 



1st Year 


• 

AP 




. D 1 






. 57 


47 


.79*** 


.000 


(Posttest) 


STEP 

IDT-; 


HA 


• to 


oo 


^ 04 
- 11 


.44 
.61 


47 
47 


-.10 , 
.17 


.310 
.244" 




So -On 


• uo - 


" 7ft 
• 1 0 - 


oo 


- 11 


.84 


47. 


.16' 


.367 • 
. 161 \ 






1 1 

• XX - - 


7^ 

• 1 u 


55 


-. 15 


.86 


47 


.26 






07 
• U 1 


7ft 
• 1 o 


55 
1/1/ 


-. 06 


.9.1 


47 


.13 


':.509 
\035 




- 1 Q 
X*l 


• J/** 


55" 
i/v 


. 25 


.87 


47 


-.44* . 




A TIC! O 


• U 1 


Q7 


55 
1/1/ 


. 00 


.71 


47 


X07 


.720 


> 


CAPS-3 


-.05 


,.77 


55 


-. 01 


.69 


47 


..>4 


.839 




CAPS-4 


1.09 


.77 


55 


-.11 


.93 


47' 


.20 ■ 


.295 


Follow-up 1 


Skills' 


.21 


1.02 


54 


-. 23 


.80 


- 44 


.43* 


,. 046 


Know 


-. 26 


..81 


54 


.27 


.96 


44 


-.53* ■ 


.011 




Interest ' 


.22 


.85 


54 


-.31 , 


.87 


44 


^ .53** 


.010" 


Follow-up 2 


.AP1-4F 
SSCh F""' 


.21. 


.64 


54 


-/27 


.71 


44 


.48** 


.003 




-.10 


.94 


54 


/ .13 


.97 


43 


-. 23 


.293 


■\ 
\ 


SS 


-.11 


.79 : 


. 54 


' .07 


.,1.00 


44 


-.18 


.399. 


WAF 


.07 


.83 


54 ; 


-.10 


■ .94 


44 


.17 


.434 
Ml 




WBF 


.16 


72 




-.25. 


.96 


. 44 


41* 




WAPF 


.06 


.91 


54^ 


-. 10 


1.10 


44 


.*16 ' 


.518 




WBPF . 


.02 


.84 


54 

* 


-. 09 

' ■ . « 


1.04 


44 ' ■■' 

< 

* 


.11 


.602 



*p ^.05 Note: Even though all p-values are given*, differences with p-values of 

"**pi .01 .'05 or less are designated with asterisks as aji^al aid to re^-ders 

**^*D<..001 in identifying variables of particular iriterest. a/ 



1. PC'S used were the student-baped input, process and plimate^oAesj Ach, Attl,^Att2, 
' Class 1, CJass 2, S Proc 1, s'.Proc^^ and Clfmate. ' 

2. ' Tfie test' of differences is the F-test 
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Table ni-15 

Unadjusted Means, 'Standard Deviations, Differences. and P.Va'lu^i^ 
of Outcome Variables (in z-score form) for the Reduced Grou{>- 



PrfitMi 



\ 



Outcome 
V:iri:il)le 



•t ' MAC06 
Mcnn 



SO 



N 



"Mo.-m 



Non~MAC06 

sn 



N 



xst i6ar 


AID \ 
iMr 1 


40 
• *tv 


. ov 






. 82 


36 


\jrOStC CSC) 








''46 


03 


* ..89 ' 

* * • 


36 






14 


.94 


01 


.95 


36 




Do L/Il 




• o*t 


• > * 

4R 


- 18 

• xu • 


99 
• «/«/ 


* 36 




V\ V\ r\ 




• o«/ 


4S 


29 


!• 04 


36 ' 




umr-n 

V> V» Xj 




77 


.45 


07 


1. 06 


.36 


- 






' 98 


' 45 


.09 


• 82 


• 36 . 




P A I^Q^O 

O It 


17 

• X f 


1 90 

X« M»V 




-.^09 


• 86 


36 




CAPS-3 


.13 


1-14." 


45 


09 


• ,79 " 


36 ' 


f 


CAPS^ 


-. 01 


.85 


45 


-.08 


• 87 


36 - 




Skills 


• lU 


111 ^ 
1. 11 


^0 


_ 19 


Aft 
• op 




t 


Know 


-.31 


.90 


45 


.34 


1. 13 


36 , 




Interest 


.34 


.88 


45' 


•-. 39 


.93 


36 


Follow-up 2 


AP1-4F 


.21 


- .95^ 


45. 


. -.25 


1.01 • 


36' 




SSCh F 


-.08 


1.00° 


45 


.04 


.97 


36 - 




SS ' 


-.04 


..85 


45 


-.12 • 


1.03 


36 




WWA^F 


.12 


.94 - 


45 


-.10 


.96 


36 




WBF 


.20 


.85 


45 


-.15 


.94 


36 




WAPF 


.17 


.89 


45 


-^2 


.86 


36 ' 




WBPF 


.05 ' 


.87 


45 . 


-.08 


1.07 


36 



.86*** 
.06 
.15 
^53 
.48*' 
.2§ 
-.29 
.26 
.22 
-. 07 
.•22 
-.651* 
1.73*** 
.46*. 

-a2 

-. 08 
-.22 
.'35 
.29' 
.13 



.000 
.767 
.491 ' 

.251' 
„. 029 
.155 
.167 
.283 
.332 
.705.- 
.339-'? 
.OOS 
.001 
.038 
.592 
.688 
.294 
.083 
.141 
.546*^ 
0 



' .05 Note: Even thqugh all p-values pre given, differences with p-values of 

♦*p . 01 . 05 or less are designated with asterisks as a visual aid to readers 

•***p<.001 in identifying variables of particular interest. 

1. PC's used were: Ach, Att 1, Att 2, Class, 1, Class,2, S Proc 1, S Proc 2 and Climate 
•■ , 2: The test of differences is the F-test. " "* . " 
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- ^ Table in- 16 ^ \ 

Means, Standard Deviations, . Differences, and P Values of Outcoipe 
Variables (in z--score form) Adjusted for 8 Input, 
•Process and Climate PC's for the'Reduced Group!' 



Outcome ' 


- 


MAC OS 




Non-MACOS' 






Period 


VnvK^HlQ 


Mean 


SD 


N 


Moan 


^ SI) ' 


N " 


P 


« 

xsv xear 






• Oo 




- 46 


. 58 


36 


.87*** 


.000 


(Posttest) 


"STfe'P 


. 09 


.42 


45 








.06 


.548 


- 


IDT 


' 1 1 


<• wo 




AO 


• Oo 


OO 


08 


.611 




Si;> Cff 


— • uo 


• 




-•'05 


. oX 


OO 


00 


981 






• Xo 


'71 

. iX 




. -•22 


oo 
. oo 


oc 
oo 












^66 


iiR 
40 


.05 


. 90 


oc 
ob 




Infill 




CAPS-l ' ^ 


— . JO 


• ol 


40 


. 15 


.73 


o/^ 

oo 


^-.4U 






CA.PS-2 


• IX 


ftp? 


40 


-. 03 


. 70 


o/* *' 

36 • 

ft 


1 A 

. x^ 


. ooo 




CAPS'*'3 


i\A 


TO' 


4o 


• . 01 


• 00 


oo 


. no 






CAPS-4 


• uo 


. 74 


At^ 

40 


-. 15. 


.75 


36 


. JU ^ 


. 0";v 


Follow— up 1 


Skills^ 


.19 


1.01 


45 


-. 23 


.79 


36 


.42 


€085 




Know 


-. 2^ . 


81 


45 


.23 


1.02 


36 


-.45 


.063 




Interest 


'.28 


* \84 


'45 


' -. 31 


.88 


-36 


.59* 


.on' 


Follow-up 2 


AP1-4F 


.21 


,67 • 


.45- 


-. 25 


.71 


36 


.46* 


.013 




SS.ChF \ 


• -.14 


.95 . 


' 45 


•11 


.92 


36 


-.25 


.309 




SS 


14 


.77 


. 45 


.00 


.93 


- 36 


-.14 


- .524 




WAF 


. , ;06 


:82 


45 


-. 02„ 


.84 


36 


.08 


.701 




WWBF 


.19 


..'72 


45. 


-. 13 


.64 


36 


.32 


..lio 




WTrVAPF 




.85 


45 


-. 15 


.83 


36 


.34' ' 






WWBPF 


.02 ' 


.79 


45 


-.04 


.97 


36 


.06 ' 


• .795 



.05 
.01 
.001 



Note: Even though all p-values are given, differences with p-values of 

.05 or less are designated with asterisks as a visual aid to readers 
in identifying variables of particular interest. 



1. PC's usod were: Ach, Att'I, Att 2'^ Class 1, class 2, S Proc 1, S Proc 2 and Clin^ate. 

2. The tcfit of differences is the* F-tcst. • * 
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.WffA, the scale presumabiy measuring attitudes toward unusual 
customs or beliefs, with MACOS classes more positive on the 
average at posttest; 

TO* " 

• Know, a scale in Follow-up 1, Ctetober 1975 (2 months into . 
the following year) indicating advantage of having learned cer- 
tain typeff of content, with non-MACOS classes responding more ;. 
^ in the direction of wishing they had learned such things than 

MACOS classes / . 

.Interest, a single scale item comparing interest in social 
- studies this year to last year, with MACOS classes on the 
average finding this year less interesting. * ^ 

Table ni-14 shows that when standardized outcome means were adjusted 

fxyt all 8 'student-based input and classroom variables (PC's)and for student-based 

process. and climate measures, the significant differences between groups were 

largely the same. The changes from the unadjusted means with respect to the 

27 

. 05 level of Significance, were: 

.CAPS 1 was significant and favored the non-MACOS classes; this 
was a measure of perception of^ ability of self as a problem ' 
solver. ^ . 

.Skills, a scale in follow-up 1 indicating perceived advantage in 
social studies this yedr of having Learned certain skills last 
year, with MACOS classes responding in the direction of wishing 
they had learned such skills; 

' .WWA did not show a significant postteat {1st year) difference 
t)etvveen MACOS and* non-MACOS groups. 

26. It should be remembered that Skills, Know and Interest were scaled 
such that the ^higher the score, the more negative the meaning and 
' vice versa. _ _ , 

27 • The reader should note that all follow-up measures were adjusted for 
performance on pre-tests {Ach, Att 1, Att 2) given in Sept70ct, 1974, 
' as well as on other measures, * They were not adjusted for performance 
on posttest, 1975 (1st year outcomes). y 



\ 

\ 
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Table II 



.^^^l^BF, a measure presumably of attitudes towards peoples or 
groups who have unusual customs or beliefs, with MAC OS 
chisses on the average scoring mor^ positively a year after t;heir 
ourse than non-MAC'OS classes; - / 



-15, giving the unadjusted means and differences for the reduced 



sample (N=81), shows essentially the same pattern of results as the comparable 
table for the larger sample of classes (Table III-ll)* In Table III-16L it can be 
seen that when tie reduced sample of class means have been adjust ecporjhe 



student based input, process and climate/ PC's the results are simijar to those 

■ ' I ' ■ / " . ' / 

for the larger sample^ but not identical; by holding to the ,05 level as the cri- 

' [ _ ' ^ ^ ' / 

terion of significant difference between^ MACOS and non-MACOS classes. In 



this case; differences for CAPS-1, Know, and WWBF were not significant by 

: ■ • 7 - / 

that (decision criterion, although it can be seen in the column of p-values that 
CAPS-1 and Know fall just short of that criterion, aad WW^F is far short of it 



(p<, .llO). 

In whic 



\ outcome variables 



on the covariance analyses made to 



should one have most confidence, based 

/ 

this point? A reasonable approach is to 

/ ' 

identify those va,riables on which the^^otal samples differecj significantly and for 
which regressions were'homogeneous\ "By that criterion, ^the two groups of 
classes (MACOS, non-MACOS) differed significantly with, respect to the following: 



Posttest / 

\ ■ , i ~ 

AP| the course specific questionnaire : * 
CAPS-1, perceived ability of\elf; as problem solver 



Fdllow-up 1_ ' 

Skills, average rutir^s of subsequent advantage of having learned 
how to do certain things the preceding year; 

Know, average ratings of subsequent advantage of having learned 
certain topics the preceding year 

Interest, class average ratings of interest in social studies this 
year, compared to last 

Follow-Up 2 
' AP1-4F , the Man and Animals part of AP; 

If one adds as a further criterion of confidence that the results were 
also consistently significant for both "analyses (total groups, reduced groups), 
one would eliminate CAPS-1, Skills and Know, although GAPS-1 and Know 
continued to be very close to beir^ significant at the .05 level, more so than Skills. 
For all three variables,' if the assumption is made that the reduced sample is 
similar to the total sample (an assumption is supported by the generally similar 
unadjusted means and variances of two groups in each saniple), one could view 
the changes as the result of reduced power, due to the small sample size. It is 
worth continuing interest in them. ' * - ^ 

What Would You Think A and B (WA, WB) show indications of di*f-_^^ 
ferentiating between groups, at this point. The indicatiojis- are not consistent, 
however, and there also appear to be interactions between groups for these vari- 

•> . » * * ' : 

ables with Climate in some cases. Thus, they cannot be designated at this stage 
^ as. variables in which one can have high confidence with respect to differences 
in oxitcomes. * . . ' 
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3) Multiple Repression Analyses 

a) Analyses with Group Entered Last " 
Th? covatiance analyses indicated on which outcome variables the two 
groups differed., They have not indicated the»relative contributions of the 



different input, process and climate variables if those are viewed as predictors 

of outcomes. To examine the contributions of different sets of predictors to 

outcomes, fixed-ordered stagewise regression analyses were emplpyed. In 
" ' " - ' . * - . . " ■ ) 

*' °* such analyses, the primary question of interest iswhiijh sets of PC's add a signi- 
'« - - ' ' » ' ' . < 

ficant i^cBement of variance accounted for, relative to^ the total proportion of 

variance (R) 'accounted for by all predictors? The analyses were made for the 

MACOS and non-MACOS groups separately in opder to evaluate differences in 

the possible contributions of different sets of PC's. They were also made for 

the combined sample, using Group (MACOS, non-MACOS) as a dummy variable. 

Two sets of such analyses were made in which the order of predictors was varied. 

The first entered jSroup last after all other variables. That procedure is anak - ' 

gous to the covariance^ analyses made in that it tests the null hypothesis that, when 

the variance accounted for by all other variables has been partialled out, group 

membership does not account fof a significant increment in the remaining variance. 

The analysis was also made entering Group after input and background variables, 

" . and before process and climate variables. That analysis is analogous to askfng: ^ 

if all that has been removed is variance from pretest and background characte- ' 

- ristics, does Group classification (MACOS, non-MACOS) contribute a significant 

increment to the total variance that'coiald be accounted for? 

.*• Except for Group as noted,above, sets of PC's were.always entered into 

the analyses in a prcdctei mined order. The order was based on assumptions- of ^ 

y - ^ ' m-59 • ' 



a temporal priority of variables with respect to effects or outcomes that is 
Implicit in an input-process-outcome model. Pretest variables for students 
were entered first (achlevement-Ach; attitude - Att 1, Att 2); Classroom 

characteristlcs„(Class iJlJlass 2) were entered next, then process variables 

- 

based on students ratings (S Proc 1, S Proc 2); and finally Ciimate. For that 
order. Group was entered either after the class set (Class 1, -llasa 2) or last, 
after the climate PC. For analyses that. .included teacher variables, teacher 
background and attitude variables (T Demo ; T Psy 1 and T Psy 2) were entered 
after cluas characteristics, and teacher process variables were entered before 
student process variables. Group in this case was entered after, the teacher back- 
ground- variables, and also last after the climate PC in the second run. 

One reason for maintaining a fixed order of entry of sets of variables 
•was to minimi.-e effects of multicoUinearity from one analysis to another. As 
has been note(3, there are non-trivial correlations among some of the PC's.- It 
was believed that by imposing an order based on a conceptual- model of the nafure 
"of the variables, the effects of multicoUinearity that can lead a regular stepwise 
. regression analysis to c'apitalize, on unstable correlations were held constant. 
It is true that different orders of entry can change ftie increment of variance 
associated with a particular set of variables. Normally variables entering the 
' analysis later are less lii^ely to show significant increments. Thus, one may 
anticipate different increments for Group when it is entered after input than when 

♦ » 

it is entered 'last. Similarly,.- entering Climatealways last or next to last reduces 
th? likelihood of detecting a significant increment with it.. It^s taken as a 



working hypothesis, however, that if Variabres were to be ordered in a tempo- 
ral sequence, climate could be viewed as a consequence of students and leachers 
, interacting ir\ a social studies course. There are, of course, other hypotheses, 
' but that was the model adopted for purposes of these analyses. 

In presenting results, increments from sets of PC's are combined 

* 

into groups designated input, process, climate and Group (MACOS, non-MACOS). 
As noted above, input contains all Sludent pretest PC's, classroom "chatac- 
teristics PC's, and when teacher variables were included, teacher background 

and pre-attitude PC's. The test of significance of an increment in proportion 

of variance associated with each of the four sets of variables (input, process, . 
climate, group) is the F-test of increments.^^ The denominator for all tests 
is (l-R2y.ABCD)/(n-k-l), where R^y. ABCD is the total multiple R-^ fo¥ the 

analysis and k is the total number of' variables in all sets. That model does 

p 

^ involve a small sacrifice in power, especially for sets containing 5 or 8 vari- 
ables. For the large sample anMyscs using student PC's for tests of the Group 

4 * 

increment or climate, Ue F^test has, at the . 05 level of significance,' a power 
iietween 50-60% to detect «n .increment of '5%; it has a power between 85-90% to 
an increment of 10%. T^ese values are based on no assumptions about the size 
of the tctal r2.29 For the same sample ther^ are 5 input PC's. The F-test has 
power .of 60-70% to detect an increment of 10%, and a power between 80-85% to 

28. Draper, N. R. , and Smith, H.' Applied Regression Analysis. New York': 
• • Wiley, 1966. . • • ^ . 

29 . They are based on an error degrees of freedom of 92 (102-8 student- 
based PC 's-Group-1). 
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detect an increment of 15%. Power for the reduced sample, ^ith the larger 
number of PC's is le.ss,or conversely, the increment that can bedfetected at 



the ♦ 05 level with a given power is larger* y 

- ^Fir^ally, if a total multiple R2 was not significant, no tests of its 

Increments were made in order to protect the Type I error rat^* . If there was 

not sufficients reason to believe the amount of Y variance accounted for >yas 

.greater than zero, there was little justification for analyzing increments* By 

the same token, if the increment for a group of sets (e.g. , input sets of PC*s) 

was not significant, no further analysis was made. ^ ^ 

Table III-17 shows the results of the analyses of outcome variables . 

when Group (MACOS, non-MACOS) was entered last into each analysis . .As 

tKejr should Jbe, these results are essentially the same as those obtained by the 

analysis of covariance. The posttest variables for which Group still added 

a significant increment to remaining variance with4iiput, process and climate 

variance partialled out,* are AP (the MACOS course content questionnaire), ihid 

CAPS-1 (perceived ability of self as problem solver). WWA (posttest) was the 

exception. The Follow-up 1 outcome variables for which Group added signi- 

ficantly are Know and Interest. The Follow-up 2 outcome variables for which 

\ . ' 
Grou{3 added significantly are AP1-4F (the Man and Animals part of AP), and 

30» Actual increments represented by these percentages will depend on the 

total r2 . Consider the increments of .5 and 10% for Group or for 

Climate, Consider also four different total R2's: .2, .4, *6, .8. 

The actual observed increments detected at the . 05 level for the 

* * 2 

level of power indicated would be: Total R 

Increments . 2 .4 • . 6 . 8 

5% 4% 3% 2% 1% 

' 10% * 8 6 4 2 
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: . , Table III-l'^ 

Increments of proportion of Variance in Outcome Variables Associated 
With Input, Process, Climate and Group Variables (f^C OS, Npn-M'ACOS) 

Using Student PC 'si/ 



Period 



uutcome 
Variable 



Pre 



Total 
Multiple 



R 



2 



Posttest 




3^** 




STEP 


81** _-" 




IDT 


55** 


• 


SSCh 


35** 




^^'^^'A 


18** • 






1&** 




• CAPS-l 






CAPS-2 


P5** 




CAPS-3 


.36** 




GAPS-4 




Follow- 


Skills 




up 1 


Know 






Interest 




Follow^ 


AP1-4F 


^ up 2 


SS Ch F 




SS 


14**£/ 




. WAF" 
WBF 




. WAPF 




*Pi.05, 


WBPF 





Increment 
' from Input 



Increment 
from Process 



Increment 
from Climate 



Increment 
from <3 roup 



. 60** 


44** r 


2 


1 


13*\ 


78** 


76** 


0 


i* 


0 


62** 


57?* 


3 


1 


1 • 


26** 


9 • 


3 


.13** 


■ 1 


36** 


23** 


vl2** 


0 


1 ^ 


27** 


18** 


7* . • 


'2 ' 


0 


21** • 


11* 


1 


■5* 


4* 


,27** 


23** . . 


3 


1. , 


■ 0. 


48** 


42** . . 


5** 


' 1 


0 


29** 


27** 


1 


0 


■1 


13 C 


0 


8 


1 


,4 


25** 


6 


13** • 


• 0 


6** 


'22** • 


4 


-9** 


3 


6** 


55** 


48** 


. 2 . 


. 0 


5**» 


10 . 


6 • 


2 


1 


1 


. 20* 


3 


4 


13** 


1 


27**. K 


24** ■ 


1 


0 


1 , , 


32** y - 


' 27** 


1 ' 


0 


4* 


8. 


6 


1 .' 


0 


1 


.16 


15 


0 


1 


0. 



**p^.01 

1. * Sample sizes for posttest outcomes 



For FU-1 and FU-2 outcomes: 



MACOS55, non-MACOS47, 
MACOS 54< non-MACOS 43. Pre-post 



2. 
3. 
4. 
5. 
6. 



correlation^, squared, are given for comparison with Multiple R'^. 
Note: incremental proportions may not add exactly to R^ due to rounding. 

Decimals and leading zeroes have been omitted. ^ 
A dash indicates there was no pre-test for this variable. 
Pretest was total AP. For pre API -4 and AP1-4F. r = . 37, . 
Pretest' was S,S Ch: SS Ch F was a modification of SS Ch. 
Correlation is with^^'Vv'A pre.' 
Correlation is with \\'\VB' pre, , 
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WWB(the scale measuring reaction;^ to people or groups with uausual customs). 
- It |s apparent In Table III- 17 that»in most cases, the set of variables . 

I 

classified as Input (student pre achievement and attitude, and classroom charac-* 
teristlcs) accounts for the overwhelming proportion of total variance of the vaiU-* 
ables. There are, however, several inf'^redtlng exceptions. Social Studies 
Choices (SS Ch), the average number of times a class picked social studies in 
preference td 5 other subjects, showed a largbr and hi^ily significant increment 
due to classroom climate. Another instance was a measure employed In FoUow- 
up 2r SS, a scale on which students made an absolute rating of how much they, 
liked social studies. For SS, Climate (from the prior year]^ also accounts for 
the major^orfion of total variance. 

Climate also contrlbuted'a small but significant increment to STEP 
posttest class averages, and to CAPS-1 po3ttest class averages. Process vari-^ 
ables contribute significant increments to WWA (the posttest measure of reactions 
towards unusual customs or beliefs), UWB (the posttest measure bf reactions towards 
people or groups having t^.ose customs or beliefs), CAPS-3 (the posttest measure 
of tolerance for ambiguity), Know (the Follow-up 1 measure orperceived advantage 
of having learned certain topics), and Interest, (the Follow-up 1 measure of interest 
in social studies this year compared to last year). 

It can also be seen In Table that for 7 of the lOT posttest measures, 

the total variance accounted for (total multiple R^) by all PC's, plus Group, 
exceeds prc-postr^ for the original variables. The exceptions are STEP, 
SS Ch and CAPS-1. In these ^Ites it appears that by creating pretest com- 
fiosites there was some loss of variance accounted for by the individual pretest, 
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The loss Is slight for STEP (2%); it is around 10% for the other two measures* 



leasures* c 
, the input PC*s 



i For the achievement measures (AP, STEP, IpT, APl-r4F), 
and Group account for the majority of variance of^the measures. For the ^ 
rest they do not. That may be due in part to the lower reliability of the other • 
measures, (i.e. the attitude measures). * ^ ' % " - 

1)) Contributions of Individual PC^s 
In Table 111-17 the increments due to Climate and to-Group are directly 
interppefcable in the sense that there is only one variable in each of those sets , 
(therd^is only one climate PC», and Group is a single dummy variable). For the 
cluster of variables called Mnput', however, there are three sets of PC's, each 
set. entered in a fixed order: pretest achievement* Ach;'pi'etest attitude, Att 1, 
Att 2; and classrqom demographic characteristics, Class 1, Class 2. For the 
group called 'process' there is one set containing two PC's: * informal, unstressed 
group oriented classes, as rated by students, JS Proc; and traditional, individual 

V 

* 

work oriented classes, S Proc. It is of interest to know^ which of those sets and 
variables was significant when entered into the analysis since it will delineate more 
, specifically predictive relationships with particular outcome variables. For exampl 
.it is of interest to know if classroom demographic'characteristics, classified in 
* thp analyses as inputs along jvith pretest achievement and attitude, account for 
& significant proportion of the total variance of, say, the MACOS course specific 
questionnaire, or the STEP test, after proportions of variance for preachievement . 
and preattitude have been removed, * ' . 

The procedure followed for these further analyses was to determine * 
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w.hether, for a given dependent variable, ^the increment for input was significant. 

If it wa^ then the inprement for each set, when it was entered, was tested for 

significance at the .05 levd.'^"^ If the set was significant, then the F-test for the 

significance of the regression coefficient was examined for each variable in the 

set (one .or two, depending on the set) as a means of identifying which (in the case of 

pairs of variables) Wap significant. The same procedure was applied to the ana- 

- ■ > * ' - • . :i ^_ 

lysis o&the set of tv|o process PC's. 



As a final step, the F-tests of the regression coefficients for variables 



found to be significant when their entry was forced were examined after all 



variables hJ^d beSn entered. That is a test of'the significance of the variable 
as a predictor if it woro entered into a regression analysis last, after all other 
variables. It is. interpreted here as further corroboration of the importance of 
the variable with respect to the dependent variable in question, it may be noted that 
the test of coefficient for Group by definition *is the same, since it was always 
entered last. Since Climate v;as entered before Group, an examination of its 
regression coefficient if it were to be entered Inst is comparable to the final 
analysis' of input and process variables. In all cases in which the increment for 
' theClimate PC was found to be significant, it was also found to be significant 

^ if tested after all other variables. ^ • . 

The results of these 'furthei; analyses are shown in Table 111-18 for the^ 



31 . It is noted again that this further procedure was not applied if the total 
Multiple w- not significant. -^^Jie reason for the stepwise testing 
within groups sets, of variables., 'br within a groUp, was to protect 
the Type I en ^ate. - , ' . 
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dependent variables that showed significant increments for input or process 

or both. .The table show s ^ for ll i e~speclfted^dependent variable, the increment * 

2 ' • ■ 

to R added by the variable or variables in a set if the set was found to be 

significant, Jlhd the standardized regression weight (Beta). It also shows which 
variable (or variables) was significant within the set, and whether It was also 
significant if added last after all variables. 

It may be seen in Table in-18 that with respect to input sets of vari- 
ables, the significant sets and variables (PC's) are in all cases except^one (CAPS-4, 
perceived creativity of self, class average), pretest achievement (predominantly) 
and ^attitude. In the qase of CAPS-4, both class demographic characteristics PC's 
ere significant. In both cases the regression weights were negative, suggesting 
"that more positive performance of classes with respect to CAPS-4 at posttesfr 
would be associated with classes having higher proportions of minority and low- 
incdme students and small size (the opposite of the interpretations given for the 
two <^lass PC's). c • \ / 

' \ The process variables associated significantly with particular outcome 
variable^ 4epend on the variable, as does thp direction of the relationship (the 
sign ofVhe regression coefficient). With respect to VIWA, both student-based pro- 

-- . - . ■■ I- •• ■ • .• " 

cess PC!s have negative coefficients. With respect to three of the four remaining 

' ' '^^ . ^ ' ^ , ' . - ^ ' 

cases, the student process variaole seem interpretable. The less^ students rated " 

the class as traditional and jion-group oriented, and the move positively the clas€ 

was rated with respect to informality, group discussion oriented activities, the 

higher the ratings (on the average for a^class) of tolerance of amb'iguity (CAPS-3). , 

The higher the rating of the class as traditional (S Prqc 2), 



Table III- 18 



Increments of Proportions of Variance and StandarcUzeU^e^resslon 
Coefficients of Variables •in Sets That Added a Significant 
Increment of Proportion of Vaflance to Outcome.Varlablesi/ ' 



A 




Significant Input Variables Significant Process ^Varlables 
Whep Entered When Entered ; Vfhen EntereU When'Entered 



' Outcome 



In Fixed Order 



/tiast 



' Period 
Posttest 


variaDie 

AP 


ACti 




65 


5fr*T 




OTVO 
OlCtf 




74 


86** " 


♦81 ** 






iAtt 2 


1 


10* 


8 




' ■ "IDT 


Ach . 


5&: 


75** 


6,4** 




WWA 


Ac^ 


* 14 ^ 


'88**- 


25 


• t 




Attl 


7 


. 32** 


33** 






Ach . 


12 


34** 








Att 1 


5 


28* • 


: 27* 




CAPS-2 


Att 2 


,17 


' 41 ** 


35** 




eAPs-3 . 


^ch 


23 


48** 


12 






Att 1 ' 


16 


48** 


. 46** 






Att 2 


2 


15* 


15' 


■ \ 


CAPS 4 


Att 2 ■ 


20, 


45** 


45** 






Class 1 


23 . 


-31 < 


-27 . 


. i 




Class 2 


27^ 


-21 ** 


-2?*- 



In Flx^ Order 
r ' Incr* 



S Proc 1 
^ S Proc 2 
S Proc 2 



4 

6 . 




S,Proc 1- , .3 



23** 



Fdllow-up 1 
F9U0W up 2 



*pU*05 
**p£ ♦Ol 



Know 
Interest 
WAF 
*WBF 
APFU 



Ach 
Ach 
Ach 




S Proc 2 
S P^oc 2. 



12. 
13 



35** 
«27** 



1. Bomple sizes for posttest analyse^: MACOS 55. non-MACOS 47; :or FU-1 andTJJ-2, 
MACOS*54/non-.MACOS 43/ - • ' « - I'M 



1 



Note: decimal pcfints and leading zeroes for incremental proportiVas Df yarlance.and 
for standardized regression weights iWebeeri omitted. I / * 



• A* 



23** 



25* 
-13 
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th'- h«>her the ratings of Know in Follow-up 1." Higher ratings for Know mban 
\ .%tu t.rn s rrttcd certain topics as not having been studied last year; and |t woUld 
have been advantageous this year if they had. The leas students rated a class 
I as traditional (S I>roc 2) the more they were apt to rate this year's social studies 
class InTollpw-up 1 as kss interesting than last year's class. 

. 2)) Separate-Analyses of MAC06 and'Non-MACOS Claafees 

Table III-19 shows the'results of analyses of sets. for each grpfip of 

,».-)' 

tlasses, MACOS and non-MACOS. The Uiblps help clarify relationships of sets 

* « * * * * « ' 

" of vi^rlables in each group. It niust be remembered, however, that th^re.is ^ • 

« 

. loss of power with these reduced sample sizes. For exarwple, forth^MACOS • 
group, the power of the F-test to detect, at the . 05 level, a significant mcrQmerit 
iof proportion of variance of 5'X' due to climate ia between 30-50%; the power to ^ 
detect an increment of Ip'f is 50-(>0%. Again, these values are taken without r«- , 
gard to the actual value'of total R^. The power of the F-test tl detect an increment 



dVe to the two process variables of 10%.is between 30 and 50%; the power to dotcct ' ' 
an increment of 15% is 60-70%. For the non-MACOS group, the power of the F-test to ^ , 
detect an increment of 15% for climate is 60-70%. For tlie, non-MACOS group, the power of 
the F-test to detect a significant Increment, at the . 05 level, of 5% is 10-30%; of 10% 
about 50%;' of 15%, power is between 60-70%.'^^ For tfie two variable procfess set in 
the non-MACOS group, the power of the F-test to detect an increment of 15% Is 50- 
60%. and less for smaller increments. Thus, one is not to be surprised that 



1;2. Again, observed effect sizes represented Ijy these percentages will 
depend on the size of the total multiple R-^. 
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Relationships 

V'ar 



' > Table 

of Sets 9f Student Based Input, Process and Climate 
iables to Outcome Variables, by Groupl/ 



' Outcomi 
Variable, 


MACOS Non-MACOS 


Increment . 

from. Input 
MACOS Non-MACOS 


Increment 
from Process 

MACOS Non-MACOS 


Incre 

) 

from C 
MACOS 


ment 
3limate 
Non-MACOS 


r' ' ' . 


46** 


.62*1= • • 


46** 1 


59** 


.0 


2 


Oi 


1 


STEP - 


. 79** 


' 80** 


77**1 


. 77** 


0 


0 . 


i 


■ 2 


ilDT 


65** 


'62** 


62**' 


5 56** 


1 


-6 . 


2 


0 




26 


• 34** 


\ 14 


17 


8 


■\ 5-w 


4 


. 11* 




3f* 


55** 


24** ' 


27** 


3 


21** 


5 


7* 


ururo 


25 


43**- 


22 


27** 


1 . 


11* 


3 


5 


caI>s-i 


11 ■ 


42** 


8 ■- 


21* 


2 


,1 


1 


20** \' 


CAPS-2 


29* 


41** _ 






O 

KJ 


A 

Tb 


1 


6 


CAPS-3 


42** 


59**,' 


36** 


52** /. 


7 


4 


0 


2 




• 29* . 


. 33* 


28** 


33** 


1 


1 


0 


0 


Skills 


' 16 


23 


'2 ' 


2 


10 


16 


c 
0 


0 


Know 


20 


21 


U 


5 


. ,8 


15 


1 


1 


Interest 


15 


11 


8 


.8 


6 - 


2 


1 


1 


AP1-4F 


. 61** ^ 


53** ^ 


59** 


47** 


^ 2 


5 


b 


1 


SSChF 


. 16 / 


18 - 


14 


9 


1 


4 4 


0 


. 5 


SS 


20 , 


. 32 


12. 


6 


5 . 


5 


3 


20 




28 


36* 


26-, 


34* . . ■ 


2 


2 


' 0 


0 


WBF 


• 33* 


45** - 


24** 


42** 


-"9 


2- 


0 


1 


WV^'APF 


3.5** 


41* ■ 


29** 


27* 


5 


.' 13* 


1 


0 


WBPF ' 


" -ii - . 


29 - 


12 


21 


2 


1 • 


2 - 


7 



**i 



^.05 

><.oi 



i: Inpiftri Ach, Att 1, Att 2, Class 1,' Class .2; Process: S Proc 1, S Proc 2; Climatf. 
' ' Sample sizes for'Posttest Outcomes (AP-CAPS-4): MACOS 55, Non-MACOS, 47. 
For FU-1 and fU-2 Outcomes: MACOS 54, Non-MACOS 43. Note: All figures 
are proportions of varia-hce;. decimal points and leading zeroes have been omFtted. 
Incremental proportions may not add exactly to r2 due to rounding. Increments for 
1^ vidJibl^s-for whicb-total was not significant were not tested, . 



there appear to.be fewer significant increments at the .OS^level of significance. 
Perhaps the more important point is that where there are significant increments 

\ ^ \ ! \ 

due to process or climatfe, one should be particularly interested in them. 



In Table 111-19 it can be seen that input continues in both groups to be 



the typically overwhelming predictor of outcome. There are cdses in which 
the non-MACOS group appears to show a significant increment di^e to input while 



\ 



the non-MACOS group does not. Close examination shows that those are all 
cases in which ^he overall was not significant in the MACOS groi^ps; there- 

for/hicrements were not tested. ? , \ 

/ - » : ^ ' 

/ Examination of Table III -19 suggests that there are some differences 

■^between MACO&and non-MACOS classes with respect to process and climate 
variables, even with increased -effect sizes detjectable with respect to given 
levels of power. The va'riables of interest are SS Ch, WA, WB, CAPS-1 
and WWAPT^ ail attitude variables, although it must be noted that total was 
I -significant in the MACOS group only for and WWAFF. Student related 

I ' • - - 

' process variables cpritribute jsignificantly (indeed, strongly) in the non-MACOS 
group to W\VA;-they a^o contribute in the same way for WWB. Climate contri- 
butes significantly to CAPS-1 in the non-MACOS classes. It should be rechlled, 

of course, tbit'si^nificant interactions l^tween groups were found for Climlate 

'\ ' • « 

and WWA. They were not found for the other three variables. For WWAPF, 
*# , • « - ' 

there is a significant increment due to process for the non-MACOS classes,, not 
for the MACOS classes. Indeed,*the face that'\\^'APF R'^ reached significance 
in both group, but .not In the combiaed groups, is in itself interesting. It sug- 
gests that the interaction- effects found earlier are potent with this variable. 



Table mrl9A . 
Raw Regression Coefficients of PC's and Constanta , 



(Intercepts), for Each Outcome Variable, by Groupi' 



1'/ 



Outcome 
Variable Ach 
AP M 34** 

N .34** 
.STEP M 50** 

N 48** 
IDT M 34* 

N. 45** 
SS Ch(x) M-OS 

" N -05 - 
WA M 26* 

• N "02 
WWB M 16 

N 05 
CAPS-1 M-04 

-N 06. • 
CAPS-2 M 12 

N 16 

CAPS-3 M 09 
' N ' 04 
CAPS-4 M 13 

• (X) N 21 
Skills (x) M-li 

N-04 

Know(x) M 10 
N 00 

Interest M-11 
"'"0 N-06 
APi74F M 16 . 

. N 36* 
SS Ch F(x)M"l2 
- N-03- 
SS (x)M 08 
.i(x)N'06 
WAF \x)U 25* 
? .4 N 12 . 
WaVBF- 14 
N 17 

\UVAPF M-14 
_Nr04 
^fWl^VTWU 29* 
(x)N 4'?*- 

♦p<.05; **p!i.Oi. ' - . , . • 

Noter^ Significance levels refer to the F-test of the significance of the coefficient. , ' 

,.<•■•'-• ... ^ • 

1,' M =.^AC0S,..N - Non-MAr OS. Siimp-Ie sizes for posttests: MACOS ^ 55; Non-MACOS = 47. Samp'i 
' .^s,lzes for FU-1 and FU-2 v.Tiflab'Ies: •"'MACOS, - 54; Non-MACOS = 43. Note: decimal points 

have been 'ojTiitted^fxom'all coefficients anc! constants, although all are in decimal form due to the 
scaling of the PC's. (3c)'^ variables for. which thq total jnultiple. was not significant at the . 05 
/ level. "See Table, III-17. ' • •* ' ,." 

Note: The regression coefficients and the constants in the final regression equation shown. 
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Att 1 


Att 2 


Class 1 


Class 2 


'S Proc 1 


S Pr(Jc 2 


Climate 


Constant 


08 


•07 


03 


-06 


i)l 


.02 , 


-00 


,369 ' 


-01 


■ 09 


" 02 


-05 ■ 


07 * 


04 ' 


06 


-410 


07 


04 


02 


s 11 ' 


02 , 


' 05' 


'12 


•'075',. - 


09 


' 04 


• -09 


00 


• 04 


05 


10 . 

4 


052 


12 


04 


09 


08 


03 


07 


' 13 : 


'019 


04. 


03 


-07 . 


09 


02 


/ . 16* 


-01 " ' 


. -162 


21* 


12 


-01 / 


-13 


-08 


-10 


. 17 

24- ' 


. 024 


-02 


13 


12 


10 


-08 . 


-15 




21* 


-03 


• -09 


. -04 


-04 


-13 5 


-20^ 


ire-- 


.19 


-22 

i 


. 16 


, -13 


-11 


-19* 


21* 


-050 


04 


" 15 


07 


13 - 


'■ -05 


y^— 00— 




089 


35** 


-13 


-10 


-13 


-01 


-18 


17 : ' 


037 


21 


05 


05 


-11 


-12 


01 


10 


-.157 


04 


12 


01 


-=17^ 




01 


32** 


362 


09 


35"^ 


-10 


20 


-11 \ 


: .-06 


12 


• 010 


15 


19 


-16 , 


• -14 


-04 • 




15 


013 


34** 


18 


• 00 . 


-05 


09 


-10 


' 06 " 


-059 • 


33** 


07 


00 . 


00 


14* , 


05 


11 


-029' 


-04 


39** 


-18 ■ 


-02 


-05- 


01 


03 


04g 


-00"'* 


' 41* 


-14 


-24+ 


-05 


-04 


-03 


-123 


-03 t 


-00 


16 


. 13 ^ 


03 


27* 


22 


158 


12 \ 


04 


-06 


12 


-05 

1 


21* 


-14 


— 33o 


02 ^ 


15 




14 


10 


15 


' 08 


. -316 * 


07 ■ 


05 


02 


y 19 - 


- ^ 05 


24* 


-07- 


171 * 


-00 


-07 


' 15 , 


-08 


' -03 ■ 


-11 


' 06 


221 


14 


08 


01 


'-05 


08 


' -04 • 


08 


-302 


14 


-09 


22*-, * 


io 


04 


-07 


-02 


131 , 


04 


07 


'06 


08 


02 


12 ■ 


-08 . 


-398 ' 


05 


Q7 


-11 ■ 


-33* 


-04. 


7-08 . 


-03 / 


-029 


.-22' 


19 


12 


-12 


05 


0 

-10 , 


17 


211 


09 


'-02 


-]7 


-49 


. -08 


-07 


14 


-089 


-24 


-.08 


07 


-06 


-09 


06 


37** 


070 


07 


-22 


01 


-09" 


-07 


. -04 


-0'4 


084 


-02 


11 ^ 


p 25 . 


04 


> 04 


-10 


-01 


-150 


04 


■ -20 , 


18 


13 


-15* 


-02 


-03 . 


139 


18 


27 


'13 


■ -01 


07 . 


' -10' 


-10 


'-266 , 


-17 


-20 


• ;34** 


21 


04 


'. 09 


-10 


116^ 


li) 


-10 


-40* 


-14 • 


-06 


-25 


03 


048', 


-04 




- -23 


.f07 


-01 


03 


-14 


114 


-10 


' -i7 


, .-44*" 


'-04. 


08 


-00 


. 22 


033 



'Table ni-19A gives the raw regression coefficients and intercepts 
for each PC for each dependent variable, by group. 

The interpretation at this point is that: 1) there were outcome variables . 
for which there appear t6 be differences between groups with respect to process 
or climate variables, even with the losis of power due to reduced sample sizes; 
2) those variables are attitudinal, not achievementj and 3) "process and climate 
variables appear tobeof more importance for non-MACOS classes than MACOS classes. 

' h) Analyses wifch Group Entered after Input ^ , 

Table III-20 shows results for the total samples'when Group (MACOS), 
non-MACOS) is eptered into the analysis following input (Ach, Att 1, Att 2. Class 1, 
" Glass 2). There are two changes for the incr^ment due to Group from .the case in . 
which that variable was entered last. The increments due to Group are no longer 
, significant at the . 05. level for CAPS-l and for WBF (What Would You Think. Part JB, 
in Follow-up 2), although in both cases Jthe p-values margitlally exceeded . 05, a^ did the 
increment for WWA, There are several possible reasons >for these diffei-ences. 

si 

One is that they are simply chance fluctuationg of significance for outcome variables, 
that have previously shown marginal or fluctuating significance In other analyses. 
Another possibility is that there may be suppressor^effects of som- variable^. Which, 
when removed, produce significance ft-^'the group variable. . ' 

\ The overall pattern of results faom entering Group after input is very 
similai\^to the results of entering jt last, after the variance of eight predictors 
has befen partialled from the criterion variable variance. „ The only change with 
respect to p'rocess variables is associate'd with Interest (in Follow-up i), for which 
the set of process PC's no longer cbntribute significantly. The ojily change with ^ 



- - . Table .ni-20 

Increments of- Variance in Outcome Viyriables Ass 
With Input, Group, Process and Climate Vari^les 
.Using- Only Student-Based PC 'si/ . 
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Outcome 


Pre-post 


1\ 1 « 1 • »^ 1 A 

MuituJie 
R 


mcrciiicuc 






Increment 


Period 


Variable 


2 

r 


irom mpui 


iroui oruup 


II UIIl It 1 LK/C9 9 


frnm niimafe 
1 


Post'test * AP 


• 33** 


60'^ 


44** 


- 16** 


1 . 


Q' . 




STEP 


81** 


"78** , 


■ 76*'* 


0. 


0 • 


, : 1* . 




IDT 


5§** 


62** 


• 57** 


. 1 


3 


,1 




^SSCh 


35** 


26** 


9 


3 


3 ■ 


. 11** . 




Wv/A 


18** 


36** 


23** 


3. 


- 10** 


0 ' 






16** 


■ 27** 


18** 


2 


5* 


■ 2 - 




CAPS-1 


32** 


21** 


. 11* 


3 


1 


7** 




CAPS- 2 


15** ' 


27** ■ 


23** 


1' 


3 


1 




CAPS-3 


36** o 


48** 


42** 


1 


5* " 


1 




CAPS-4 


96** 


29** 0, ■ 


27** ■- 


1 


-1 


. 0" 


FolloWr 


up l Skills 


2/ 


13 


- '0 


2 


10 


0 




Know 




25** 


6 


10** 


9** 


. .0 




^ Interest 




22** 


u 


"13** 


S. 


2 


Follow- 


•up 2 AP1-4F 


32**^/ 


55** 


■ "48** - 


6** 


1 


0 




■ SS Ch F 


f 4/ 


10 


6 


' 0, 


2 


2 ■ 




SS 




20* 


3 


■ 0 


4 ' 


13** 




V^'^VAF 


1 


27** ■ 


24** 


■ 1 


1 


0 




WBF 


14* v*^/ ' 


■ H2** 


27** 


3 


1 


1' 




' . \VWAVF 








i 


0 '-^ 


0 . 




mVBPF 




16 




0 - 


0 


1 . 










> 




K 



*pi.05. 

**p^ .01 ' V. ' ^ . * ' 

, 1. Sample sizes for posttest putcomos: MACOS 55, niDn-MACOS 47. For FU->1 and 

FU-2 outcomes: MACOS 54, non-MACOS 43. Pre-post .correlations, squared, are 
, given for comparison with Multiple R^. . / ' 9 ^ 
Note: - incr.emental proportions may*ncH add,exactly to due to rounding. Decimals 
, and leading zeroes have been omitted. 
2* A dash indicates^^here was no pre-test'for the variable. ^ 

3. Pretest was total AP. For pre APl-4 and APl-4F,/r2 ^ 37^ . • ^ 

4. Pretest was SS Ch;' SS Ch F was a modification of SS Ch. 

5. " Correlation is with WWA pre. " ' c 

6. Correlation is with UWB pre. 
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resjJect to Climate is associated with WA. posttest, for which Climate no longer . 
adds a significant increment. That^isFpossibly because the interaction observed 
ln.the homogeneity of regression analyses has, been absorbed by the group variable. 
Otherwise, while the absolute sizes of increments change somewhat in'this 
-analysis from what was previously found, the overall patterns appear to remain 
quite stable. That is taken to lend further confidence to the identification and 
interpretation of group effects and of orocess and climate relationships. 33 

' Table III-20A shows for each outcome variable the standardized regres- 
sion coefficients of input PC»s at,the point at which Group was eutered, and of all ^ 
predictdrs after all were in the equation- 

" -c) Analyses with Teiacher PC's Included 
' ' How do teacher variables contribute to^he variance outcome mea- 

sures? Table III-21 gives the results of analyses with Group (MACOS 5, non-MACOS) 
^added last. In these analyses, input includeslin th is order of entry; Ach, Att 1/ 
Att 2, Class 1/Cir3s 2, T Oemo,- T Psy lAj Psy 2. That is, teacher background , 
and attitude PC's were entered after student pretest and class PC's. Process in- 
eludes in this order:" T Proc. i/T Proc 2, i?nd S Pi^oc i/S Pr^ 2. Process PC's 
based on teacher's ratings were entered before student process PC's. 

Table III-21 shows largely the same pa'' rns as the preceding analyses..,i,v 
The differences -are at least in part due to reduced power (the sample sizes are " 
smaller), as discussed earlifir34' it is also possi^e that the reduced sajtiples „ 

^ c 

- ' 33. Inpu t variables in this Analysis are of course identical in characteristics - ' 
"■ to what they were in the prior analysis, ' " , 
34 Tn this case, with N = 81 and 6rror degrees of freedom = 66, power for- 
' ' the \05 level to deteqt an increment for Group or Climate of 5% is . 
* |)etween 30-.'30%; it is between 70-75% for an jncrement of 10% (cont a, . 
p. ITI-78). 




^ Table ni-20A ^ 
Standardized Regression Coefficients for PC's for Each Outcome 
Variable at the Step in Wxich Group was Entered Before 
Process/Climate PC's and for Eacn PreCictor Entered!/ 



Outcome 






T not if 








• Proces5/ClimatePC»s 


I ■ 
Ach 








1 ^ 

Class 2 


Group 








Variables 


Att 1 


Att 2 


Class 1 


0 jrroc 1 






AP 




05 


10 


04 * 


.09 










sis*.* 


'04 


09 - 


02 — 


-08 


•*40*\^ 


Art 

07 




STEP- 




- 09 • 


09 


-04 • 


Q< 


AO \ 

02 \ 




08 






81** 


08 


05 


-06 


05 


06 


\ 07. 


IDT 


67** 
64** 


09 
07" 


06 
05 


02 

00 


05 
07 


-08 
-08 


12 


Ib^ 


AQ 


•. ss Ch 


-11. 


16 


27** 


05 


-02 


-18 










.-10 . 


16 


15 


05 


-op 


-09 


-13 Y 


U4 


• WA 


20 


30** 


-09 


02 


-03 


-IT 






Ul 




25 


33** 


-11 


•05 


*-05. 


-13 


-25* 


^ OA * 




15 


26* 


09 


05 


^ 01 


-15 










16 


27* 


04 


03 . 


• ' -01 


-07 


Ar? 

-07 


\ 


ID 


. CAPS-1 " , 


03 


21 


,20* 


-01 


-19 


17 








03 


20 


11 


01 


-17 


22* 


-09 


AA \ 

09 \ 


OA* 


CAPS-2 


21. 


.14 


38*** 


-24 


00 \ 


-08 


/. 








23 


15 


35*.* 


. -24 


-01 


-04 


-11 


1 A > 

-10 


1 A 

\ 


CAFS-3 


15 


47*+ 


17* 


08 


-02 


-07 






\ 




12 


■ 46*+ 


15 


-01 . 


*'-04 


02 


23^* 


-07 


\ ^ A 


CAPS-4'^ 


24 


-02 


44** 


*-30* 


-22* 


-08 








26 


-02 


45** 


-27 


-22* 


-10 ' 


-09 


-03 


AK \ 


Slcills (x) ' 


. -09 


01 


01 


06 


03 


-15 




35** 






-13 


-Ql 


00 


11 


09 


-22* 


07 


A^; 
Ob 


Know 


. 14 


06 


10 


. ^09 


15 


32** 








Ifiterest 


09 


05 


11. 


-08 


' i9 


26* 


1 A 

' 18 


27* 




-13 


08 


12 


24 


-07 


-Jo** 










-14 - • 


07 


09 


.47 


-0.9 


-267 


1 A 


-lo 


1 *\ 


' AP1-4F * 


• 46** 


07. 


-01 " 


22 


07, 


—24 * 








• 


46 


07 • 


00 


21 


08 


-25** 


1 1 

. , 11 






ss Ch F (X) 


08 


r06 


15 


-02 


-23 


05 






10 


/lo 


-06 


10 


-03 


-24* 


12 


A^ 

-06 


A»7 

-07 


. SS 


10 


-03 


07 


-15 


-12 


-03 










12 


1 

-06 


-04 


•C£>-15 


-13 


09 


-19 


02 


43** 




oO* 




—11 


lU 


02 


-11 










32* 


09 


-12 


17 


01 


-10 


-09 


-05 


01 


WBF _ ■ 


23 


15 


^03 


20 


07 


-17 










26- 


16 


-01 


24 ' 


07 


-21* 


" -13 


-03 


-10 


WAP;F(x) 


-13 tf 


-10 


-17. 


'^07 


.05 


-09 ■ 








-12 


-09 


-16- 


' 07 ' 


" " 04 


-09 


-03^ 


-09 


-06 


^\>WBPF (X) 


■ 58** 


-07 


-12 


-51^* 


-01 


-07 






10 




58** 


-08 


-15 


-49** 


00 


-07 


-03 


10 
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Nole: Significunce levels refer to the F-test of the significance of the regression we ght. 
(x)*= variables for which total multiple H^^'v/aii not significant at the .05 level. . 
1. . For each eutcotne 'ariable, the top line shows the regression weight for input PC's and Group at 
step in wWch Group was entered. The second line shows the weights for each PC and for Group 
•• if each were entered lagt after all o^er variables. Posttest N = 102; FU-1 aod FU-2 N= 97. 
S!Ote: decimal points have. been omitted from all weights. 
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- - Table ni-2.1 

'irxcrements of Proportion, of Variance inOutfiome Variables Associated 
With Input, Process, Climate and ^Group Variables (MACOS, Non-MACOS) 
Using Student and Teacher PC' si' 



\ 









Total 




Increment 


f 


Increment ' 




Outcome. 


Pre-post 


Multioie 


Increment 


Increment 


from Group 


Period 


Variable 


2 

,r 


from Input 


from Process 


from Climate 


(M,.N-M) 


Posttest 


A? % 


33** 


64** 


46** 


1 


- 


16** 




STEP 


81** 


.79** 


. 78** ■ 


0 


1* 


0 - 


• 


IDT 


55** 


56** 


'53** 


2 


1 


0 




SSCb. 


35** 


37** 


13 


9* 


■ 15** 


0 




\VWA 


18"* 


50** 


30** 


15** , 


-0 


4** 




WWB 


16** 


33* 


24** ' ' 


7 


1 


1 




GA,PS-1 


32** 


27 


% 17 


2 


4 - ■ 


• 4 




CAPS-2 


15** 


40** " 


31**. 


7 


1 


.1 




CAPS-3 


36** 


55** 


49** ■ ^ 


4 


2 


■0 




CAPS-4 


26**,. 
- 2/ 


29* 


25** 


2 


" 1'.- 


0 


FoUow- 


Skills ■ 


26 


8 


' 12 


3 


. 3 


up 1 


Know 




3*4* 


8 


18** 


1 


7** 


Interest 




31* 


8 


- 17.** 


2 


4* ."' '" 


Follow- 


AP1-4F 


1 


59** 


55** 


1 


0 


.3* , 


up 2 


SS Oh F 


12- 


6- 




2 


0 


- SF . 




■24^ 


.5 


- 7 


11 ' 


0 




. SWAF 




37** 


31** 


6 


, 0 


0 




WWBF 


■A, 14**i^ 


38**. 


*' ^ 33** . 


4 


0 


1 




WAPF 




19 


11 


4 ■ 


' 0 


- 2 




\^'\^^BPF 




.17 . 


1 ' 


0 


0 


'*p 4.05 






















/S .1- 











1, Sample'sizefor all outcom.es M^ACOS 44. 'Non-MACGS 37.' . 

Pre-pos6 correlations. squant^J, arTgiven for comparison with. Multiple 
Note: Jncremental proportions may not add exactly to R? due to rounding. 
/ Decimals* and leading zeroes have been-omlfcted. 

2, A dash indicategVhere was no pre-test farJ:he variable. 

3. Pretest was total AP. For pre API -4 and APi;>4Jg\' r2= , 37. - 

4. Pretest was SS Ch; SS Ch F was, a modification of SS Ch, 

,5. Correjation'is with WWA^pre/ . ^ ^ ^ ^ 

. 6. Correlation's wfth WVB pre. ' ' ^- , ^ 
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are not simply random samples of the larger samples. That Is, some differences 
maybe due to the samplfs having characterist'-js that are a systematic, not 
random",' part of. the total group. The principal changes of Interest center around 
.WA, which here is significant, arid W'\\'l3F, which is not. Overall, however^ 
patterns' of increments appear similar to those found 'Jith larger samples. 

The reason for doing the analyses with the reduced samples was to be 
able to examine the relationships of teacher variables, along with student ones, 
;to different measures. The same .analytic procedure as before has been follpw'ed,, 
with the following exception. If a group M.sets of variables was significant in the 



larger samples but not. in the reduced samples, the group was also examirfed in 

the latter. The Justification for this departure from the general^rlnclpal followed 

in these analyses was'to compensate for the loss of power due t'b r^tioed sample 

" \ » • 

sizes. The justification of course rdsts on the assumption that the reduce^sample 

was Vi random sample of the larger group. It jvas. believed, however, that coV ^ ^ 

elusions could be qualified to minimize the risks of misstatement or erroneous interest. 

' TALe III-22 indicates the results of analyses pf sets of input and process^ 

• . ' \ 

variables. It shows for each outcome vafiable.analysed, the increment -of variance ^ 

added by,the indicated PC, if its set wa's significant, and-the regression coefficient 

° ■ * "• c " . 

of the when it was enjered and in the final eguation. 

— It may be seen that there are^outcome variables for which the teacher^ 

"a 

background set does contribute a significant increment of variance, and -that in. four 



^ ' again, these increment estimates are not observed inqfements, whlch.'will 

depena bn the size of the to^il multiple r2 . ' For the set of process PC's 
' . (4 in all), power of the F-test fs between 10 and 30% for an increment of 

5fo; between 50-60% for a 10% increment, and betweeh 70-75% for a 15%^ in- 
crement. For a set of two PC's the power of the F-test for the . 05 level 
I . . of significance is'Vtween 30-35%^o detect an increment of 5%, between ^ 

60-70% to detect one of 10%, .ind-between 80-85% to detect an mcrement of 15%. 
. ' . ■ III-78 X _ - 



. Table ni-22 . ^ 

Increments of Proportions bf Variance and Standardized Regression 
' Coefficients of Variables in Sets That Added 'a Significant 
Increment of Proportion of Variance to Outcome^ Variablesl/ * 



Significant Input Variables 



Significant Process Variables 
RTien*- Entered When Entered 







Outcome 


In Fixed Order 




Last • 


la Fixed Order 




Last 


Bnriod. 


Variable 


Var. 


Incr. 
40 


Beta 


Beta 


Var 


» Indr 


Beta 


3eta 

< 


Posttest 


AP 


Ach 


63**- 


60** ' 












o / 

SXEPf.-^- 


T Psy 2 


• 3 


-19* 


-Ig 


» 




\ 








Ach 


74 




83** 


* 0 




*• 








idt' 


Ach 


51 • "■ 


71-**- ■ 


62*'^- 




• 










SS Ch 










S Proc 1 


5 . 


-29* 


-22 






WA 


Ach , 
' Att 1 y 


. 11 


33** 


-02 


S Proc 1 




-31** 


-30*-* 








13 


44** 


-50 


S Proc 2 


8 


^27** 


-27** 




^ < ♦ 




T Psy 2 
Ach 
Att 1 


2 
10 
9 


-15 . 
- 31** 
36** 


-22* " 
05 
35** 


T Proc 1 


1 


-11 


-30** 






CAPS-1 


Ach • 


10 


' 31** 


. 19 














CAT S-2 - 


Ach 


2 


14 


32* 














Att 2 


18 


43** 






9 












Class 1 . 


5 ^' 


-32* 


-37*,' 












/ ' . 


. 'CAPS-3 


^ch ' 


26 


51** 


28=*^ 


S Proc 1 . 


3 


23* 


26^' 








Att ] 




34** 


31** 
















Att 2 . 
T Psy 2 


■ 8._ 
5 ' 


, 28** 
-22* . 


25** 
-13 














CAPS-4 


Att 2 


'21 


46** 


46** 











Follow-up 1 



Know 
Interest 



S Proc 2 
T Proc 2 



Follow-up 2 


AP1-4F 


Ach I 


44 


66** 


49** 






T Psy 1 


5 • 


-25** 


-19* 


• 


VVWAF 


Ach 


15 


39** 


.28 






T Psy 1 ^ 


6 - 


20* 


22*. 




WBF 


Ach 


16 


40** 


23 


0 




"T Psy 2 


6 


.-26** 


-29** 



15 
. 14 



43** 
-43** 



♦p^.05 

'I 

1. Sampleslze.i for all outcomes;.. MACOS 44, Non-MACOS 37. . ^ 

2. Att 1 and together iTdded a significant increment of 2; neither PC significant alone. 

3. Student process set signif cant; neither, PG-alOne sigaificant. . 

Note: decimal points and leading zeros for jncrcn^ental proportions of variance and for 
regression coefficients have been omitted. 
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out of six such cases it was T Psy 2 (the PC related to scoring.higher on Educational 
Scale VIJ Traditionalism, and Teachers at Work)» The outcome variables involved 
are ^P, WA, GAPS-3, AP1-4F. WAF and VJVfBT. The (^Irection of associa- 
tion of T Psy 2 In all but onp case is negative (that is, the sign of the regression 
coefficient Is negative), suggesting thaf higher values of that PC predict ^ lowering 
of class average scores for the variables* The Interesting case Is AP. At post- 
test, here the Implication appears to be that more conservative teachers are 
Dredletive of decreased scores on the MAC OS questionnaire. For AP 1-4F In 
Follow-up 2. thfe teather set of input PC's adds a significant increment of variance, 
but it is the other PC (T Psy 1) that is significant. The direction of predictive 
associati(fti is, negative. For WAF, T Psy 1, (general emphasis on ma.ny different 
objectivesj not associated with traditionalism or progressivism) is a significant 
pre^Jictor ax/d positive in direction of influence* ^ 

- Teacher-based process PC's contribute significant increments -of vari- 
ance to WA and to Interest (in Follow-up 1). The PC involved in \\WA, along 
with both student process PC's,is T Proc 1. All process PC's have negative regres 

sibn coefficients, suggesting a complex set of p.ossibIe relationships. It jyill be 

■* » ^ 

recalled that this outcome variable showed anMnteraction of group^ with respect to 
Climate. It is possible that by entering process variables in the analysis prior to 
entering Climate, they are arc including some effects of Climate. T Proc 2 is 
associated wjth Interest in Follow-up l^in a seemingly interpretable way. It would 
appear that the mor^f teachers tended t^ate emphasis on individual work, recall 



or qomprehension^, the more students tended to find this year's class more interest- 

ing than last y4^r*s. Tor other cases in which sets of process variables acJcounted 

for significant increments of variances it was' student based process ratings.ac^ 

III-80 - / 
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-found in the earlier-analysis. 



. 4) Conclusions From Analyses of Covarjance and Multiple Regression Analyses^ 
Differences between MACOS And non-MACOS class means for twenty outcome 



•variables have bo^n examined by two major methods: multivariate and univariate 
analyses of variance and covariance, and multiple r^ression anajyses. In addition, 
the associations of input, process and climate variables have been exanained to 
identify potentially influential vadables, (PC's) with^ respect to the different outcome j 
%variabl9S. The fallowing are the main evaluation findings at this stage. 

* • 1) There is consistent evidence in all analyses that tliere vere signir 
ficanMiffcrences between MACOS and non-MAC06 classes with respect to 



th^'iollowing outcome variables: 



y 



Posttest 



7 



AP, the MACOS gpqcific^te><t; MACOS classes orfthe average 
^ scored significantly higher. , • ^ . ^ 

Follow-up ]. * . „ / ;" * 

Know, ah average o^fjummated ratlHigs'df Whether certain subjects 
had been Iear.ned last year and how advantageous it was this 
year in social i^tudies; non-MACOS clai^ses^on the average , 
had higher scores, if^^the direction of indicating they had not 
learned them and, wished they had, than MACOS classes; 

Interest, .a sii^Ie scqie indicating. how interesting students found - 
social studies this year compared to last year; MACOS 
classes on the average rated it in the direction olf being 
• ^ Je^s interesting this year.^^ \ • , " 
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/ 



APJt-4.F, the mrfn and animals' part, of ■'^^P; MACOS classes on the* 

average continued tp.ricore higher than non-MACCS classes. 

35, This scale was repeated iji FoUownip 2, .It was not used in the preceding 
analyses^sTncQ it was believed.that Interest in' FU-1 w'as bijsed on the 
more inimediate^confraet for students;. • It was found that the relation:ihip 
deseribed^here for. Fl)-1 continued to hold in, FU-2. ' '_ 

. " ' ■.. . . 111^81 . ' 



2\ There is evidence, althoilgh Itjwas not consistent in ajl 
analyses , that thete were differences between 'Hie two groups with 

respect to the following outcome variaibles* 

*^ * . ^ 

. ' . "Pfisttestl " * » 



WWA, an average rating of reactions taunusual actions, customs 
..or beliefs; MACOS classes. on tfik aver^age tended to choose 
- more positive reactions than non-MACOS classes* There 
was, however, non-homogetfolty of regression for the two 
' groups ^on thl9 variable \^ith respect to c^lassroom climate. 
The^interiiction suggested non-MACOS classes that rated 
] , climate lower than the average for -all classes gave WffA 
redactions that were lower than expected, icomparecjl to 
^- MACOS classes wlth climate ratings in the same 

/ ^ range. The r^elatlon^ip (the regression slope) of climate 
j * to ^\WA was significant tot non-MACOS cldsses, not for 
/ MACOS classes. 

CAPS-1, a measure interpreted to refer to perceived ability of\ 
I self as problem solver;' non-MACOS class peans tended 
to be more positive on the average than thc^ MACOS 
cla^ajneanj 



3) 
from 



\ 



' Follow-up i 



^VmBF, an average rating of reactions to people or groups having 
unusual beliefs or 6ustoms; 'MAGOS classes showed some 
evidence oi checking more positisc^ reactioM, on the 
average^than non-MACOS classes* 



i 



There is marginal evide/fcejlfrom Sf^e set-of analyses, but not * 



other, that there was a -slight differe<\ce^.betw(?en groups on the 

\ r ' I ./Mi; 

averag<uWIth respect to Skills, an average of su>nmated!ratings of certain 



skills learned in social studies last year that' mqy have been advantageous 
this ye^r. Non-R4ACOS classes tended to give a little more positivyfe 




.1 . . ■ 

4) There is consistent lack of evidence in all analyses of differences 
.between MAC OS and non-MAC a ."lasses, on the average,with respect 
. to the following twtcome variables. 



1 



Posttest 



< 



STEP, a standardized test of social studies Skills and knowledge. 

IDT, the Interpretation of Data Test of interpreting and using ethno.- \ 
graphic information 



SS Ch , the class mian of the number of times social studies was 
chosen as preferred to 5 other subjects. 

i ' ^ I 

> W'\\TB, an avewge rating of reactions to people or groups having 

unusual customs or beliefs. ' , " 



CAPS-2, an average measure for the class interpreted as Interest 
fin problem solving. / • / 



CAPS-3 



an average' fneasure for the c^'ass iuterp|reted as tolerance 
'Of ambiguity, jn probl/;ms. j j' 

CAPS-4, an average measure.for thc^class interpreted as perception, 
of self as creative in thinking. / 

^' Follow-up 2 , • • 

- - »* 

SS Ch ip,.the class mean of the nuniber .of times social studies was 
, chosen as- preferred to 3 other subjects. • * 

SS, the clsjsp mear >f ratings,of how much social studies was Ufked 
• '/ this year per ■ not relation to other subjects. , , - 

V\^VAF, an average rating of reactions to unusual customs, actions , 
or beliefs. • • • . 

"* ' ' ' (' ■ ■ '■ 1 

WAPF,jan-av?rage rating of reactions to two examples of unusual 

•behavior of a hypothetical peer. ■ • ^ 

, ■ ' ✓ ■ ■ ■ ' ' ' _ 

mVBPF, an ayerage rating of reactions toward a person having 

-those behaviors. • , 



5) There is consistent evidence ihit student pretest variabl.es 

t 

jiccount*for the ovelhvhelming proportion of tdtal variance with most • 
measures* Classroom characteristics^did not,with>one or, two exceptiotts 
jrelated to CAPS, account for significant increments ia the total variance 

of outcome variables.^ There is evidence that teacher background 

* 

attitude characteristics were related toperformance^of claisses on 

the MAC OS questionnaire (AP, posttest, ^Ad again on AP1-4F, Fpllow- ' 

V 

up-2); to reliction on \WA, posttest; and ^fJ^^AF and A^^^F ratings 
Follow-up 2; and to CAPS-3 (tolerance of ambiguity). . ' 

6) There is indication that student ratings of classroom activities or^ 
processes may be related to ratings of social studies preferences 
(SSCh), \^^VA, and CA-PS-3^^tolerance of ambiguity)^ posttest; and 

to Know and Interest ratings in Follow-up !• There is indication that 
teacher-based rat ipgs of emphases or activities may be related to 
student performance with respect to "^^VA, posttest, and ratings of 

cr . ' - - 

Interest in Follow-up 1. , 

7) lutings of classroom climate by students showed a relationship 
to posttest performance^for SS Ch (preference for social studies),*^ 
and for the STEP test, and for class average ratings on CAPS-1, 
ability of self as a problem solver. It was associated in Follow-up 2, 
with class average ratings of how much sociiil studies was liked, (SS). 

8) Examinatiqn of increments of variance due to process. or climate 
fn MAC OS and non-MACOS groups of classes separately suggest 
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a generally stronger relationship of those variables with non-MACOS classes 

* ' - 

t^ian with MAGOS classes with respect to attitude outcome measures. 

* » . * ** 

^ ... * 

c. Comparisons of Groups with Respect to Individual Process and 

. Olim ate Vari ables • ' ^ 
^ Regression analyses using principal components as predictors indi- 
cated relationships of process and climate ratings to certain outcomes. Further 
analyses were made to determine whether there were differences between MAC OS 
and non-MACOS classesf on the average, with respect to those variables. 

A multivariate analysis of variance, with Group as the independent 
variable and the 8 student based PC's as dependent variables, led to the con- 
elusion that there was a significant difference between groups* (Fg. 93 «2. 602, 
p<*013). Results of the univariate tests are sunimarlzed in Table ni-23. The 
two variables for which the individual F-test were significant were Climate 
(p^.003), and S Prpe 2 (p ^.002). S Proc 1 was not significant (pi. 086). The 
other PC's (Ach, At.t 1, Att 2, Class,!, Class 2) have p-values ra'nging from . 2-. 9-. 
Results were similar when the analysis was done to include all teacher based PC's as 

0 

? " * * / 

well. The difference betvve.eh groups was significant (Fj^3 ^^=1.965, p^.037). ' 

The individual variables that were significant were Climate (p< .003)\ S Proc 2 

» 

(P^.005), TTroc 1 (p -1.026), TP roc 2 (p ^jr- 001), and T Psy 2 (p-a. Oil), 
t Psy 1 was marginal (p<.077). ' / \ ^ ' 

^ ^ • On which particular process and climaje^ariabt^s were groups different? 
An analysis of variance, with Group as the independent variable, was done using 
each process and climate variable individually as the dependent variable. The 
results for each variable are summarized in Tabfe nrr24. • Table ni-24 gives the 
means, standard deviations, sample sizfes and differences for each variable. - 



, Table 111-^23 * . 
.Means, Standard Deviations, N^^s Differences Between 
• Means a&d p-Values of Univariate F-tests (df 1,100) 
of Differences Between MAC OS and Non-MACOS 
Classes on 8 Sttident-Based PC^s 



Principal 
Compoaent (PC) 

Pre-Achievement 
Ach • 



^ Pre Attitude 



r 



Att 1 
Att 2 



Classroom 
' Characteristics 

Class 1 t 

Glass 2 

Student Perceived 
Processes 
S Proc 1 
' S Proc 2 

C lassroom 
Climate- 



Mean^ 
.07 



MAC OS 
1.60 



, 11 1. 26 
,01' 1.06 



,26 
,49 



1.81 
1.67 



N 
55 



55 
55 



-.01 • 1.59 -55 
.17 . 1.21 55 



55 
55 



.44 1.33 55 



• Non-MACOS Difference jt 
Mean" _SD_* N 
1.60 * 47 . 



-.11 



•-. 17 
ilO 



-.00 
-. 17 



-. 36 
.49 



-. 47 



:i8 



1.63 47 



1.13 



1.-.78 
1.52 



.28 



1.60 ' 47 -.01 



1.68 -47 



,34 



589 



,324 



47 -. 11 . 632 



47 __.62 
47 -.'9ia** 



1.66 47 



.91 



,976 
,237 



.086 
. 002 



.003 



**p ^ .01. 
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. . ' - Table HI- 24 

Means, Standard Deviations (SD), N^s^arid Differences 
and P-Values of F-Tests of Individual Student and Teacher Process 

and Climate Variables 



t 

00 










MAC OS ' 






Non-MACOS 


.- 


Difference^-" 




Source 


Variable 


Mean" 


. SD 


N 


Mean 


SD 


N 


P 


1. 


Students, 


Tchr Talk . 


2.56 


.33 


57 




.34 


51 


14* 


.029 




Process 


Speed (Pace of class) 


2. 08 


.13 


57 


^2.08 


.17 . 


51 


.00 


..925 




Variables 


Listen 


T.86 


^46 


_ 57 


1.72 


/.39 


51 


V .14 


,098 




' 6 


Discussion ^ 


1. 24 


.22 


57 


1.44 


. 33 


51 


A /\ ^ ^ ^ 
20*** 


. 001 






Stress (Grades) 


1.74 


.39 


57 


1. 53 


■ -.34- 


51 


.21** 


.005 




\ 


Compare « . 


1.25 


0 .24 


57 


1.46 


. 33 


51 


— . ^^^^^ 


Ann 
. UUU 






Joking 


1.72 


.42 


57 


1. 75 


.46 


5J. 


-. 07 


!442 






^ Memory 


3.49 


.73 


57 


3.37 


- .87 


51 


. .12 


• .387 






•5 'translation 


3.37 


.54 


57 


3.47 


.56 


51 


-.10 


.374 






Interpretation 


3.74 


.51 


57 


3.77 


.53 


51 


-.03 


.789 






Application^ 


' 3.49.. 


.73 


57 


3. 37 


.67 


5i 


.12 


.387 






Analysis 


3.50' 


.34 


57 


3.48 


- .43 


51 


.02 


.806 






Synthesis a, 
Evaluation 


3.67 


.70 


57 


*3.20 


.54 


51 


'• . 47*** 


-.000 




N 


1.72 


.42 


57- 


1.79 


•.46- 


51 


-.07 


.442 






ODI (Opport. Discuss, 


3.37 


.59 


■ 57 




. -.55 ^ 


51 


-.01 


' .907 






Involve) 










e 






.181 






Test/Grade Stress 


2. 96 


.43 


57 ' 


3.08 


■ .48 


51 


-.12 






2. 


Teachers', 


Empha^^s Qn Affect 
Memory 


4.27 


.73 


56- 


3.49 


'1.02 


49 


. 78*** 


.000 




Process 


2.76 


1.02 


. ' 55 


2.80 


■ .91 


49 


. -.04 , 


.'842 




Vari^les 


Comprehension 


2.79 


• '.99 


' 56 


3.49 


.79 


49 


-. 70*** 


.000 . 






Application 


.4. 04- 


. .S3' 


56 


" 3.51 


.94 • 


49 


.•53*** 


.005 




V 


Analysis 


3.63 


1.02' 


56 


3.15 


. .82 , • 


■48 


.48** - 


.010 






Synthesis 


■ 3.86 


.86 


56 


3.27 


.89 


48 


'. 59*** 


:ooi 






Eyaliiation 


3.69i 


1.05. 


55 


3.40 


.84 


•48 


.29 


.119 . 






Indiv (Activities) 


- 1.94 


.43 


57^ 


' '2.02 


. 52 ■ 


•51 


" -. 08 


.410 


9 




Group (Activifa^x 
PM .(Perceptual 


2.37^ 


.45 


57/ 


2. 26 


. . 58 ' 


&1 


.11 


. 267. 




1.99* 


.-46 


• 57 

/ 


2.09 


x, . 55 • 


51 


r.lO ^ 


.329 

0 






Motor Activities) 




















Total Gp (Activities) " 


2.27 


..43 


57 


0 * 2. 19 


^ - ' 


51 


.08 


.392 



1. *P6.05; ** .01; ***p6.001.. 



Table III-24 Continued 



Source . 

3. Students,., 
CliKaate 
Variables 



VariablQ 
fisfaction 
^pathy 
)ifficulty 




MAC OS 



Mean 
1^89 
2. 29 
2.40 



SD 
.35 
.29- 
.16 



._N 
57 

57 



"Nog-M^CQS- 

Megn 'SD - _ 

'2.13 .34 51 

2.11 .32. 51 

2. 30 . . 2i 51 



Nrf. Difference- ^ * 
" 1. 24*** . . 
.19* 
.10* 



P 
.001 
.016 
.017 



1. ^^.05; *"** 



a 

I 

00 
00 



- 101 . 



ERIC . 



102' ' 



It also gives In eacK .case- the p-value of the #-statiStiof The variables are listed 
according to source, "^tudent^ or teachers. In the case of student variables, 
the "raw score'' was the class average! fn c&se oHeachers^ the "raw score" 
was-th©4eacher's rating, or average stale values for variables such as 
individual, Group, PM and Totpl Group, in** which sets of ratings were summied 
• ^nd averaged. For cases in which there wfere two or more teachers '|n a 
' class, ratings were averaged. ' . - , * 

Note that these analyses were "based* on all classes in Ihe^fitudy., In 
the case of the teapher b^sed ratings, there were a few omissions on some 
individual scales' in both groups. . " . 

% . Table III - 24 shows the following significant differences between^grdups: 

* 

Student Perceptions , / . ^ ' ^ 

s . - .MACOS classes, on^the average^^ rated the*teacher as talking * ■ 

more of the time than did aoa-MAGOS classes (Tch Talk).- 

^ % , . MACOS classes were rated as having more dis'cuesiotx than , 

were} non-MACOS classes (Discussion) / • 

* MACOS classes were rgted as having less concern wfth gi-ades. 
''than were non-MACOS classes (S^ess, Grades) 

. MACOS classes were rated as doing^more comparing of things 
ta find oufe how they are alike or different th&n wete non-MACOS • 
classes, on the average (Compare)l 

' - ' ^ .MAGOS'classes, on the average, were rated lower oh synthe- 
sis (making up n^w thjngs^rom what was -learned, such as 
stories, pictures, poems, plays, reports, 'etc.') fhan were 
hon-MAG OS classes (Synthesis) - * , • 

* . MACOS classes,* on the average, were^rated mpre positively 
• on the classroom climate Satisfaction scale than were ndn- , * 
^ ' - MACOS (Satisfaction)' \ 



36 . Table 111^7 listed the vsriabliss discussed here under S Proc 1, 

S Proc 2, T Proc 1, TT'Proc 2 and Glimate. ; It gave^the polarity of the- 
variables and their correlations with the principal components. ^ 



ErIc - / . . ■ T{f3 ' 



if 



* ,^ . .MAC OS classes, on the average, were rated more favoral)ly 

.on the classroom climate, apalhy scale than were non-MAC05 
^ ,/ classes (Apathy) , . " ' * \ 

.li^AC OS-classes, . 'on the average; were rated as less/diffi,cult 
' ^ than were non-MACOS classes (Difficulty) , ; . 

9 ' ' ' ^ 

Teacher Ratings . ^ . 

%t * . . .. o 

^ c MACds teachers rated their curricula as emphasizing affec- 
V " tive content (values, ^itudes,, enqiolions) tp a greater extent, 

on the averagqi^ than non-MACOS teachers rated theirs (Affect). 

* . Npn-MACps tieachers rated their curricul^i, op the average, 
< ^ as specifically aiming^ to develop student achievement on the 

•comprehension level (underst^ding what is^being communis 
, . cated but not necessarily relating to other things) to a greater 

• ^ extent than did MACOS teabhers (Comprehension) ' *^ 
. / . ^ ^ ^ ^ . / ■ ' ' 

* ^ , . MACOS teachers rated their curricula as specifically aiming 
. to develop Student achievement on the application, analysis and 

; \ ^ synthesis fevelp to a greater e>ctent, on the average,^ than non-* 
r MACOS teachers rated theirs (Apf>licafcioh, Analysis, Synthesis ).^''^ 

Th^ results based on stujJents' peirqeptlons were coniSistent.in general, 
with information'obtained from interviews with students and tape recordings of 

' ■ • ' ■ ' ■ ' 

classes (presented^i^ Sectioh V"of this report), particularly with respect ^o the 
lack of differences between groupjs onihe scales indicating emphasis on different 
cognitive levels of activities {Memory, Translation, Interpretation; etc. ) There 
'was variation among classes within each group on a' number of dimensions having^ 

to do 'with" teaching strategies and student activities. . But often similarity was 

. . \ • - ^ . « .\ 

observed in prevalence of activities reported between grouQ^. \ . ' " 



87. .Definitions for these were: Application - using knowledge, methods, 
theories, etc. , in new situations (to sol^e problems, for example); ' 
Analysis-breaking sometjjing'^aown into its component parts and under- 
^ standing the interrelationships of the parts; Synthesis,- putting things 
together to form a new entity such as a ne^y idea$ new hypothesis, or 
. set of relationships. , ^ ^ 



Tl)ier« are two poitits of particular interest in tjie student-based- 
ratings. Disdussion was one of cle two items making up the ODI^scale; 
"Stress.CGrades) was one of thetwo'Htemslnaklng^ip the Test/Grade Stress 
scale;3o jak^^ individually, they discriminated between*the two groups of 



rilasses; cortibmed with the other item, the^scales did not.* 

fhe differences between groups, on the aver-age, with respect to 



the climate variables are noteworthy. It^should be remembered, hoWevert - ' • 
that thpse three variables produced only one significant principal sonipooent (PC), and 
At acoounted for 82% of the variance among the^three spales. thus, the.three - 

scales, with the 5th and 6th grade students, may- have reflected a genemlizeci 

- / ' ' ' \ ^ • " 

attitude tow*ard their social studies .classes.. That in itsieff-would still be^a 

meaningfulixesult. It iS stated here a^caution against|9verinterRrfitlng thei^ 

.'implications of each variable separately. 

The analyses of the individual process and clinjaie variables^ and 

^ ' c ! ' - 

of the PC 's^ support th^conclusion that the MAC OS classes wfre perceived or 

rated- differently on a number of v^riabiesjhan were thSlimi-MA'GOS classes; 

on the average^ It should not be concluded or inferred, however, tljat all ^COS 

classes were rpted. absolutely higher .(or low^r) than all nor?^MACt)S classes on 

any' variable, ^here were many<5lasses in eacK group that were rated higher (or 

lower) than many classes in the other group. 



yg. The items were included separately in these analyses, along with the 
scales, since they werfe considered 'especially important characteris- 
tics per se. The zero order correlation'of Discussion with C5t)I is .56. 

' , The correlation of Str^^^S^rades) with Test/Grade Stress is . 87. 



Similarly, no inference' can be dr^n about any particular curricu- 
*lum in the noai-MACOS &roup» Statements cannot be made from the .data%. 

♦ • # • 

. t)res8nted here about the Taba curriculum. Holt Data Bank,, the Harcourt, - 

' ' ■ ' • • • - ' ' ' ' 

Brace; Jovanovich^program, or ofher,s that were included in the non-MACOS • 

' •' * ' * - • 

group. Statements-pertain 6nly to the non-MACOS'classes as a donglomerate. 

. Analyses of variance, with Group as the Independet^ variable, \Vere alsV 
" done using ionx scales-from Follow-up 2., The questiph asked wasr "How does 
THIS "SfEAR'S sociaj studies class coittpare to LAS'LyEAR'S social studies 



class on each of the following? - * . * ^ _ ' 

.Amount of reading put loud in class . * ^ - ^ 
d .Amount pT class dl^cussiori t - ' \ . 

, . .Amount of work yo« do alone ' * . ' * 

* V - , Amount of.art work, drawing, makUg things 39 , • ? ^ . 

. students rated' those items on, a 5-point scale (1 = a'lot more; 2^' 



more; 3 = about the sam-^''= less; 5 = a lot less). Results were analyzed " . 



, • 'using class means and are shown in. Tat 'e 



39. ^rhese ttems had b'een selected for use in Follow-up 2 ff-om a -longer 

list used in FoH^^w-uf) 1 because ihere had appeared to be differences - . . 

between groups on them wh^n analyses wsre^based on responses of • . ^, 

studenta as the uajt of analysis* It was 'of interest to determine how ' 
* those activities would be/issessed by students after hhving had*their y 
present program for a year. In the present (FU-2) analyses, the units ■ . • * 
ajre class averages for each scale. - . • 
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Table ni-25 

Means, Standard Deviations, Differences and P-Values 
For Comparisons "of Activities 



MACOS - ' . - Noa-MACOS 

Ac'tivity_ Mean ' S£i N 

Reading 3.46 .67 56 

Discussion CS 2. 85 .59 .56 
Work Alone '2.28 .41 ^ . 56. 
Art, etc 3.53 .68 • ' 56 



Mean 


SD 


N 


Diff 


P. 


3.42 




48 




.773 


2. 50 ; 


.60 


48 


.35**- 


.004 


2.36 • 


.54 


48 


08 


.3&8 


3.47 


.67 


48 


.06 


.685 



**p<.01 '» 
- On the average, former MACOS classes, a year later, rated their 

current^rograms as involving less class discussion, compared to 

last year's class, than did the former non-MAOOS classes. It may be seen, 

however, that' with respect to absolute scale values, both groups meaiis tend^ 

to fall to the left of the mid-jioint; that is, in the direction of saying more this 

year than last. Thus, a more precise statement would be that former non- 

MACOS classes, on the average, rated their current programs significantly 

more in the direction of having more clasy-discussion, compared to last year's 

"class, than did former MACOS classes . Although the data are not.shown 

- ■ ■ - . (i ' , 

here, it wais found that 6th graders (current 7th graders) were more likely to rate 

their current^classes in the direction of less discussion than 5th graders (current 
6th graders). •=» • - 

, This finding was interesting in light of the tendency for MACOS stu- 

■ dents, on the average, to have rated their classes /gher in amount of discus- 
sibn than non-MACOS students during the MACOS year. 
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d. Classro om Climate Viewed as ati Outcome 

it was seen above (Table III-24 ) that there were significant dtf- , 

. ■ ' ' ' - t " ' 

ferences between the two groups of classes with respect to classroom climate 

■ ■ ■ '* 
variables (Satisfaction, Apathy, Difficulty) . Based on students; average ratings, 

MACOS classes were higher on the average in satisfaction, and lower in apathy 

and difficulty, qomparedto non-MAC OS classes. It has also been seen In 

•main analyses -inyolving input," process and outcome variables, that classroom 

climate has'been treated as a ^ocess, or predictor, variabit^. 

• J Climate characteristics could also be viewed as outcoiiies related to 

prior variables. To examine' this relafionship, a fixed order regression ana- 

lysi3 of each variable was made; ugitig s?ffdent and teacher PC's as predictors. 

The order of entry of sets of PC's folWe^Jhe order used for all regression 

analyses. Group was .entered last in order to examine its si|,nificance when all 

other variable's had been taken into account. The total sample size for these 

analyses was 85 (46 MACOS and 39 uon-]VL^CX)S clas^es>< 

Results are summariz'ed in Table EI- 26. it can be seen that for 

satisfaction and apathy, the sets of variables that addeajSignificantly to the 

multiple^R? were teacher characteristics and student process ratings. With 

respect to difficulty, it, was pretest^and'teacher characteristics that added sig- 

, 'nificantly. v - • " * 

' , Group did not add significaptly ailWall. other variables had been removed. 

Examination was made of when the partial correlation of Group with climate 
variables ceased to.be significant if Group were to be entered into the equation next 



III-94' 
103 




Total 

Variable Multiple 
Satisfaction 
Apathy 
DifRculty 



' Table m- 26 

Increments of Variance of Climate Variables Associated With PC\s (N=85) 



1/ 



Increment 



-Increment- — increment o 



Increment Increment ♦ ' 

due to ' due to ' * due to ' due to ' due to 

Protests Class Characteristics Tchr C-haracteristics Tchr Process Student grocess 





.05 . 


.00 . 




: . 14** . 


.05 

** 


;30* 


.06 


.00 ■ 




.12**' 


' .03 


.33** 


.09* 


.04 




.10* 


- ,06 



^10** 

.07*» — 
.04 



.•I 



I 

CD 

CO 



!• Order of entry into analyses: Pretest (Ach, Att 1, Att 2/; Classroom Characteristics (Class 1, Class 2); 
\ * Teacher Characteristics (T Demo, T Psy 1, T Psy 2); Tfeapher based Process Variables (T Proc 1, T Proc 2); 
Student-based Process Variables*l;S Proc 1, S Proc 2). Group was entered last as a dummy variable, with 
-MAC OS =i, non-MACOS = 2. Increments may not add to total multiple due to rounding.- 



' after each preceding set. For satisfaction, the partial correlation for group 
beca'me non-significanf only after aft. other variables had been enterecf. 
For apathy and difficulty, it became non-significant after the teacher characteristic^^ 
had been entered (T Demo, T^Psy 1, T Psy 2). That suggested a stronger 
relationship of those variables (as a set) to the MAG OS and non-MACOS groups 

. _ . W I" ' 

• . _ _ „ _ . »^ J «• % 

with respect to apathy and difficulty than was the/case with satisfaction.* 

The variables whose regression coefficients were significant 

after all variables had been entered were: * ^ " o 

*p * ' - * ^ ^ 

• For Satisfaction 

[ - . / " * i.: ^ ' . ^ - 

, : Att 2 ' _ . ^ ^, . 

^ Proc 2 * . 

. For Apathy ' " , ^ . * 

. . *TPsy.2 : . . ; - . ' . 

• ' • For Difficulty , , ^ * ^ , 

Att 2 . 
Finally, Table in- 27 gives the zpro order correlations between the 

* three climate' variables and the PC and Group variables. 

* - <v - . « ' , *> 
Considering all these data and taking into' account the polarity of the climafe 

variables, the following appear to be relationships of predictors toojlimate 
variables viewed as criteria: ^ 

.the set of predictors as a whole accounted for significant 
proporti<Jns of varianceof each climate variable; 



7taken as sets, neither student pretest nor demographic 
(Class 1, Class 2) characteristics added sfignificant 
increments to the variance accounted for in satisfaction and 
apathy; student pretest variables as a set did show a' signi-' 
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Ta^eIII-27 
Correlations of Climate Variables with PC*s_ 
and Group (N=85)l/ 







Satisfaction 


Apathy " 


Difficulty 


1; 


Ach 


• .01 


.16 


.23 


2. 


Att 1 


-.04 


.17 


.18 


3. 


Att 2 • 


-.22* 


.18 - 


.19 


4. 


Class 1 . 


.05 


.10 


.21* 


5. 


Ctiass 2 


-.03 • 


.06 


.19 . 


6. 


T Demo 


.09 


.-. 05 


-. 05 


7. 


T Psy 1 


-. 05 


-.01 


-.08 ■ 


8. 


T Psy 2 


.36** 


" -.36** 


-.33** 


9. 


T Proc 1 


-. 23* 


.19. 


.10 


10. 


T Proc 2 


. 28** 


-. 28**, 


-.32** 


11 : 


S PrpCc^l^ _^ - 




-. 01 ' . 


•A6 


12. 


S Proc 2 


.43** 


_ 34** 


32** 


m. 


Group ■ 


. 33**- ■ 


_ 29** 


-.25* 



1. The climate variables were arcaled such tfiat fcS' Satisfaction, the 
/ lower the gbore, the greater th^^satisfaction; fdr Apathy and 

Difficulty, the higher the score, the less the apathy and difficulty. 
For a sample of this size, correlations, qf.appx'oximately . 21 and 
.28 are^gnificant at the .05 and .01 levels-respectively 



*p <: .05' 
**p -< . 01 



2 



ficant increment for the difficulty variable; 

^ .when addeii after student input variables, teacher charac- 
"ferrstics as a'^ef addMi"sigtiificant incTem^^^^ 
^ anc'e accoiuited for'^in all three climate variables, account- 
ing for 40 to 50% of the remaining variance; 

> student process yariablejs^ when added as a set after input ^ 

and teacher process variables, added a significant increment ^ 
to the variance accoCinted for in s atis fact ion; and apathy (and 
^ accounted for 78-83% of. the remaining variance); they^did 
not add a significant increment witfilthe difficulty variable; 

. .Group, added after all other variables, did not add signifi- 
X5antly to what little variance remained for any of the three 
climate variables; ' ^ ' ^ 

. when considered ^fter all other predictor variables, Att 2 

and S Proc 2 were significant predictors of satisfaction; the 
more students in a class, on the average, were \ 
interested problem solving, and perceived themselves as 
pofentially creative, and the less^the class was perceived as 
* having little discussion and as traditionally Qriented, ^ ^ 
the better the cla^s aver^g^ score on the satisfactipn-scale; 

.When considered after all other. predict^ors, T Psy 2 ^as a 
^ significant predictor of class average scores on the apathy 
scale; the less the teacher tended to hold traditionaf views 
an^to approve controlling behavior (as measured by ES vn Tra- 
ditionalism <and TAW'scores), thQ less indifferent or apathetic the 
class average ratings by* students on the apathy scale; 

i ^ ' ^ , ■ , ' ^ ^ 

.when considered after all other predictors, Att 2 was a signi- v 
ficant predictor of difficulty; the higher the class scored on 
interest in problem solving and on being potentially creative 
thxtikera^vOn pretest, the less :,it. perceived the social studies 
curriculum as-difficult; " - . ' 

.the indindual teacher characteristic that was always the in- 
fluential variable^O. when added as patt M the set of three (T Demo 

T Psy 1, T Psy 2) was*T Psy 2; climate variables were more 

As measured byjhe significance of the F-test of the partial beta 
Coefficient in the equation. 



positive when teachers tended to be le^s traditional, as 
• measured by scpres on ESVn^Traditionalism and TAW. 

.the individual student process variable that was influential 
as a predictor pf satisfaction and difficulty, when added 
.as part of the set oftwo (S Proc 1, S Proc 2} was S Proc 1; 
the less the students perceived the class as traditional 
(emphasis on remembering facts, relatively less discussion, 

" . etc. ), the more positive the perceived satisfaction and the 

' - less difficult t&e work was perceived to be^ . . 

The gehe^tfal conclusion drawn is that in the social studies classes . 

examined here, classroom climate is strongly related to teacfi'er attitudes and 

to how students perceive the operation of the. class. It is also related to how 

,a class_olMud.€*i.ts perceives itself with respe ct to intere sfin problem sol v- 



ing and to perception of selVfes- as potentially^reative thinkers. -It does n6t 
appear related to achievement levels or to demographic characteristics of ^ 
classes/ fl^ere are significant differences in classroom climate between 



MAGOS and non-MACO^ glasses as a whole, Tliose differences are diminish- 

ed wTien other factors are held constant. . ■ . ■ . . ^ 

e> ' Implementation of courses - . . ' 
. Preceding analyses h^ve treated (M^COS ^ridVon-MACOS) classes as if 
they were homogeneous with respect to content and amount of implementation. 

That wds of course not the case for the grou^ pf classes labelled non-MACOS, 
' ' ' " ' ' . ■ • \ " ■ ■ 

whic1> included a variety of different programs"' or curricula. It was not the case 

either with the group of classes called MAC OS jn this' study. They too varied Nvidely 

with respect to cpntent and amount ofeimplementation. It was Apparent to the pro- 

ject staff during^.visits to classes, and from repeated i;itervie\ys with teachers and 

Students, that there was much, variation among MACOS and non-MACOS classes 

> 



not only with respect to characteristics such as those depicted by the process 
and climate variables analyzed above, but ulso with respect to cdnteat, emphasis, 
, amount of class time, and relationships to oUfer aspects of the school's overall ' 
program. The interview material, discussed ua Section V of this report, depicts 
variations among classes withinJDOth groups in muQh detail. In this sub-section, 
results primarily of quantitative analyses of variations in implementatioi\, and 
their, relationships to outcomes, will be presented. . 
' ' '1) Variations in Implementation , , - - . . ^ 

_ a) ^ What were MACOS courses? , . 

In keeping with the non-experimental, minimally idtrusive design of 
this study,, teachers (MACOS and non-MACOS) were not asked to keep logs or 
*^|^-^a::e^ as tlie school year progressed in order to minimize the impact X)f the 
project orTwhat^was actually being taught in-social st udl,e^clag&6S:=aad-certai 



to avoid suggesting what^buld bellaught and how. In the late Spring of 1975 prior 
to the posttesting, course ^ontent forms were mailed to^both groups of teachers. ^ , 
MACOS teachers were asked to fill out a detailed questionnaire (MACOS Course -' 
Checklist) specifying what units ahd Idssons were covered, what length of time ..^ 
was spent on a giv^en unit, what 'MACOS materials were.uaed, and what slipple- 
mentary materials and activities'^ere included''in the MAQOS program. A second 
form, called "For Classes That Had MACOS and Other Programs," was also fi '.ed- 
out, by MACOS teacliers. That form asked about other curricula, units, and materials 
and"about approximate lengths of time spent oa non-MACOS^sbCial studies units. . 

Non-MACOS teachers filled out a similar checl^list asking for the same information 

' . ' ** • • 

about their social studies program, although not in lesgon detail. Again, these • ' 

V. - ' " ' - * 
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three forms were collected late in the school year,, giving teachers the maximum 
opportunity to report on what had achially been done in thei^lassrooms during - 
the vear^ Strong assurances wete given to teachers that the checklists,, while 
. extensive, were not mednt in any way to suggest that there was a preferred course 
content or time schedule. ; , * : " • * . 

Class time spent teaching spciaL.studies varied greatly from class to 
class, but on the whole, there was little difference between MACOS and ixon^ 
* MAC OS groups. As Table 1X1-28 shows, thejt^o groups on the average sp6nt about 
3+houre a week (showa in minutes)' distributed over .four days, on social studies. 



Table III-28 ' . ^ 
s Tim# Spent TeacfiiAg Social Studies 



in MACDS and Non-MACOSL Classes 




MACOS Classes ' ^ Mean SD N 

'# of minutes per wk ' . , 19^.6 59. T 53 

# of days per wk ' 4.3 v .96 

# of wks MACOS was taught 20-. 6 .' 7.9. 

# of weeks MACOS alia x>ther - 29.7 
was taught ^ ' . • >- - 

Non-"MACQ6'Clas.ses ' - ^ ~ . ' 

/># of minutes per wk , 186.6 . 60.3 , 51 ' 
a #' of days per wk ' '4. 4 . 91' • - 

# wks spent on social studies '26.7 7.6 25 ^ 

- ' ft 

As reported on the course checklist, .none of the MACOS classes spent more than 

30 weeks of the school year on any kind of social studies. . / 

' . ' • <? , . . 

Course content varied widely in MACOS classes and^as would be'cxpccted, 



in non^MAGOS groups* In only four School districts was there^ evidence of 
district wide^Jicy.for social studies curriculum. Otherwise, school buildings 
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and individual teachers agpea'red free to develop their own course direction, con- 
stramed-primarily by budgetary considerations, :state requirements and tiieir • 

* . • * . « • 

^ own Tntef ests an4 aptitudes., 

*" 

Variation in sequencing of units and lessons taught in MACOS was pracr 
. , ■ ~ ■ ' ' 

tically non-existent.;'That is, teachers ^id notVafy the order of lessons within 

vhlits from the sequence set^by the developers. Nor did they vary the order of units 
(e. g; , they-did not -go from the unit on baboons to the unit on herring gulla). 
Omission of lessons within the sequence, however, and ia many cases, of entire 

* -V. 

units, was the rule rather than the exception. On the 55 classes for which there 
is information on MAC OS. implementation, only 14 teachers reported covering 
100% of the 26. lessons 6n Man and Other Animals, and only 2 teachers covered 
100% 'of the 36 Netsilik4essons. ^Thirty thre^ classes were reported as '^teaching 



' 90% or more of the Man and Other Animais lesbons and 16 classes reported the 
. same (90%) for the Netsilik. The total percentage of all lessons cWered by the , . 
time of posttesting ranged from 16 to:-100%. . , " 

The MACOS Course Cheeklist did not ask for reasons for excluding 
■--^irtii^^iiu^ lessons, but a tally of omitted lessons^did not reveal 

any particular pattern of omission. Even Ihose lessons which might have been . ' 
^ consideiiea'sensitive, such.as the mating of herying gills in the filmstrip "Herring 
Gulls", or .the story, 4'Birth of a .Hunter", or/Old^igtak" (leaving .an old woman 
£0 die on tletce), were 6mftted no more fc/quently th^n other non-controversial 
, mbteriais. such as "Chimpanzees: Ap^ate Contrast" or "How Netsilik Tools are 
Us^'^~Three of the 55.MACOS teachers did report, however, that they had 
left out a sensitive lesson or booklet beca^se (»". . .local publicity." In a small 
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nunAer of other reported cases (3 or 4)^principals and teachers reported 
toakii^decisi9ns as to whether to include possibly controversial materials and 
In all cases decided to do so.*^ , . ' ' 

' J With respect to Man: A Course of Study ,^ informationJrom the sup- 

- • ^ ' • / * 

plementary form suggests three main types, of curriculum variations: 



MAG OS as the primary curriculum, supplemented by MAC OS ^ ^ 
• related units/ " ^ " 

MAC OS and atiother social studies curriculum taught currently. 
MACOS used to supplement other texts or program packages,- \ 

A small number of teacKers (18%) reported supplementing MAG^bS-^ 

\ 

units, w^th MAC OS-related activities or programs such as ^teacher-developed, 

lessons on ecology, dissecting fish,, map and graphing skills, simulation games, 

« •> 

».-• '"* 

units on the modern Eskimo, kinship charts, etc. Other special units tied to 
MACOS dealt with evolution and natural selection, with health and reproduction, 
sharri^g and family life, contrasting Eskimo community life with, say, an African 
or native American tribe* .fliese MACOS teachers mentioned in interviews tliat 
in their experience MACOS was uniquely suited tp stimulate explorations in a 
variety of other subjects, for the most part topical or contemporary father than 

historical. ^ * . * ^ 

Teachers using most of the MACOS units andiessons 4n tandem with 
another text, program 1iackag;e,or teacher developed materials, constituted the 
■ majority (about 2/3) of those classes called MACOS in this study." Frequently 
a unit of MACOS would be tai^ht, then a unit on,for instance,the American 



41,. Further information about the handlinfe of sensitive or cdnfrpversial 
subjects, obtained from interviews with teachers, is repoW;ed and 
discussed in Section' V. ^ ' ^ ^ 



.Revolution or South ^America, or state and Ic^tel history/ Some classes started 

with the EskimcLUnit and went on to other programs; some stopped at Eskimos 

•• » 
«» ^ ^ 

and took ufijessons on-careers or, for example, SRA social studies materials* 
'In ail, 29 different texts and programs other than MACOS*were mentioned 
explicitly by this group. 



In the third type or category of classes, MACOS was used to supplement 



the^primary curriculum - whatever it might have been* This group, spent as 
little as 9 weeks, and as much as 25 weeks on MACOS. Often only the Babooa 

- -■ . : r . ■■ . . - 

unit, 01! the Salmon or Herring Gull units would be taught. Several teachers 

reported that they found the entire animal sectiofe too long; th^ students lost 

interest in the subject. And from this experience, thejr had planned from the 

Start to cover only parfs of the MACOS course (unbeknowst to the project at ^ 

the *utset){> Geography, U.S; apd Wprld History, ancient myths, current events,^ 

Glasser^s discussions, teacher apd student c|jevised projects on community 

^w.areness, family life, understanding onesself are but a small sample of the 

topics dealt with in these social studies classes. ^ • ; 

In all, 51 different .texts, kits and teacher devised programs were 
• . r , ■ • ' — . ' : ' ' 

mentioned as the main tools for teaching social studies. Holt Data Bank, Con- v 

<• , : _ _ ~1 ^ 



cepts and.yalues .{Harcourt, Braced Jovanovich), Taba,and Silver Burdette's 
^he Changing World; North and South Anlerica accounted foV 50% of the programs 
used. Fewer non-MACOS than Mj^boS teachers reported using teacher devised 
materials. ^The most frequently mentioned ^supplementary materials ^yere^ilms 
and map skills Jedsons. -Les?' frequently mentioned'topics and materials were . 
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current events, research techniques, group orpcess, T. V., ecofogy-«wr the Bi- 
centennial* . . • ♦ • < V , • 

2) Relationships of implementation to outcomes in MAC OS classeg 
Three variables were selected as measures of implementation of M^COS ^ 

^in order to examine^ relationsl>ipsjof implementation to* outcomes: ^ 

. * . f ' " * 

.timet. an estimate of the^puniber bfrhours spent teaching MACOS, 
based on data reported by the teachers; 

' .pjBrcentage of Man and other Aqimals lesson% taught. by the tixne of 
posttesting ( May 1975), as. reported by the teacheri ' 

. p ef centage of Nets ilikr les sons taught by the time of posttest i ng, 
as reported, by the tisacli^i'. » , , - 

The percentage,6f lessons taught were based on the total number of lessbnff 
. • ' ' V ^ * ■ * ' . * • 

available in the Man and Other Animals part 'of the curriculum, .or in the NetsJlik " 

* . , * » T ' 

" part. Time was estimat'ed in hours'by taking the number of minutes of social 
studies per week and. multiplying by the total: nuiiiber of weeks the tfacher reported 
spending on lessons covered to date. The number was divided by 60 to gfve total 

■ o . ; ' . - ' V, ■ ^ ^ 

hpurs. ■ , ^ • - 

" , ' '• • , - . . ■ "> 

A canonical correlation analysis was made of relatio'nships between 

... ^ - ■ ^ • • •' ^ ; 

the implementation variables as predictors, and posttest. Follow-up 1, and 

FolTow-up 2 sets^of variables as criteria. Only the first ^canonical correlation 

for the set of posttest variables was significant (Rq = -64, p^.02, N = 55). Table 

III-29 gives the correlations of the variables in each set with the canonical variate. 



> 
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• Table ni-29 
Correlations of Implem.entation and Posttest Outcome 
Variables With Their Canonical Variates 



' Implementation Variables 
- Time 

% Maa.and Other Animals Lessons 
%Net8ilik Lessons 



-Postteat-Oiitcoroe Variables 

AP (Animals and People) 
STEP- . ' 



K IDT 
SSCh 
WA 

• CAPS-i 
..-^ -JCAPS-a 
* - , CAPS-3 
- ■ ' V CAPsUi 



(Rir .64, p < .02) 



Correlations with .Predictor 
Canonical Variate * 

• .79 
.83 

Cforrelatlons ^ith Criterion 
Canonical Variate 

.19 

-..01 ' ■ 

.18 

• .-37 ^ ■ 

V32 

- v31 
* • .-1.02 

■ . 23 



* Table ni-29 showls that the three Implementation variables all correi- 
late highly with their canonifal variate. Oa^the outcome side, attitude variables 

^ - ■■ ■ 

correlate more' strongly w)th the posttest canemical variate, compared to the ^ . 

achievement variables, SS Ch. (Social Studies Choices), WA (What Would You 

-Think, part A/.opl^ybns about customs or beliefs), WB (Wfiat Would You Think, 

part B, opinions about persons who would have such customs or beliefs); ahd CAPS-2 

^Interest in problem solving) all correlate more strongly with the variate than do AP 

(the MAC OS course content test), STEP, or IDT (the Interpretation of DataiTest). 
^ * " - . - ' 

These analyses used, the total Animals and People (AP) score as one />f the 

posttest land follow-up outcomes without' taking Into, account pretests, fhirther 
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analyses were madd of the relationship of amount of implementation of lessons 
in ihe Man and Other !Aiiimals and the Netsiljk sections of the course to the two 
parts of the Animals and People test related to those s*ections;iiam*ely, APl-4 
and For these course content specific analyses*, a different implementation 

variable was substituted for amount pf time. MACCS teachers had been asked 
at the end of the year (at posttest) to^ look at the Questionnaire About Animale ahd 
People (AP) and to check any itenis they may have used with their students during 
the year for teaching or testing purposes. Classes were coded according to 
wh.ether the teachers indicated any use of some or all items during the year or no 
^'^use was made of them. Of 54 MAC OS classes for which there were data, about 1/3 
' had used some or all of them. • * * - 

A multiple regression analysis/was made for each of the following 
t outcome variables: * * 

.Animals and People, questions l-4,(APl-4), posttest; ; 
. . ^ \ Animals and PdOple, questions 5-8, (AP5-8), posttest 

.Animals and People, questions 1-4(AP1-4F), Follow-up 2. 
The predictor variables in each case were: - . * 
.APl-4 pretest; ^ . 

.^AP5-8,pretest; 

..." ' ' ' - ^ • 

. Percentage of Mavi and Animals lessons taught (relates to API -4); 

.Percentage of Netsilikiessons taught (relates to AP5-8); 

42^ Many, of the items'^in AP are to be found in the MACOS booklet, Evaluation 
Strategies, which is part of the total package. Teachers sometimes ^ 
use items" from it to- introduce a unit or lesson, sometimes to evaluate ^ 
students at the end of a unit. Some teachers do not use them at all. In 
. order not to interfere with normal implementation of the course, no 
instruction was given to teachers durit^ the year, about whether or not to 

use them. 
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^' ' . .Items used (used = 1, did not use =2) ^ 
.Percentage of 5th grade students in the class 
• The unit of analysis w|S, as with'alT preceding ainalyses, the class 
mean* Results of tijese analyses are given in Table III-30, which shows, for 
each outcome vajiabie,-.tlie total proportion of variance accounted for (total 
multipl^f^) by the six predictors, and the staiMardized regression coefficients 
(B^tM^pr^T^^ regression equation. Indication is^alsc given 

.whither the regres/ion coefficient is significantly different from zero. The 
significance lest associated with each variable is the measure of whether the 
varrable would add a significant increment of variance accounted for if it werB 
entered into the analysis last after all other variables. It is tl^us a test of the 
significance of the standarf^iaied partial regression coelficient. 

The-results given in Table IK-30 indicate that for the Man and Animals 
part of AP; (API -4), pretest and age (% 5th grade students) are the particularly 
Important predictors of posttest and Follow-up 2 performance. On the other hand, 
for the Netsilik part of the instrument (AP5-8)^ the percentage of Netsilik lessons 
taught, along with pretest ^cor^s on API -4 were the more rrtiportant variables. 
Age'(%5th graders) was less important in the total equation, and not significant 
if added after all other predictors. The Beta^in this case was not significantly 
diffelrent from zero.^^ Pretest class means for AP5-^ were not significant pre- 
dictors of AP5-8 posttest scores. None of the implementation variables, witJi * ^* 
* the one expecti^on noted, was an important predictor of posttest or follow-up scores. 
^ These results do'' not mean^at amount of implementation of MAC OS 
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Table ni-30 

Total Multiple R^, Standardized Egression Coefficients (Beta) 
for Regression of AP Posttejst and Follow-up 2 Scores on Pretest, 
-implementation and Grade Level Predictors Variables 



Outcome Variable 



Total ' ' \ 

Multiple APl-4 Pre ^AP5-8 Pre %Mart'Animal Less^s %Netsilik Lessons Items Used %5th Graders 



o 



" A Pl-4 Posttest . 53** 

AP5-8 Posttest • 54** 

a API-4, Follow-up 57** 



.05 

**p^ .01 



Beta 



55** 
. 53** 
.'46** 



Beta 



.06 
.11- 
.14 



Beta 



-. 08 



-. 11 



-. 10 



Beta 



' .07 
.25* 
-.09 



Beta 



Beta 



-.11 
-. 14 
.01 



^.26* 
.17 

-.31** 
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lessons is of no consequence. The Animals and People (AP) instruments provided 
the measure that most strongly and consistently differentiated between MACOS 
and flon-^GOS classes. That is, the two groups differed reliably and signifl- 
cantly in performance on the course specific instrument whether or not adjust- 
ments were made for student, teacher, process and°climate characteristics. 
The results do suggest that within the group of MACOS classes, pretest on the 
. Man'and Animalspart of AP*(i. e.-, A.P questions 1-4), and the age or grade level 
of students appear to be more important factors than just how many Jfan and., 

* Animals lessons were taught, or whether the teacher used any .or all of the items 

- 

at all. during the year. They also suggest, "however, that with.respect to the 
Netsilik part of the test (AP5r8) it did^ matter what percentage of the units and " 

• lessons had been taught at the time students were posttested. ' . 

, One reason that the AP2-4 pretest was an important predictor of class ^ .' 
^iverage posttest scores for AP5-8 as well as for APl-4, while AP 5-8 pretest was 
not, may be that questions 1-4 are more like a genergU-achievement test in format 
(and, posSible content) than questions 5-8, and if 'so, students who could Handle 
. such formats w^e apt to be able to handle the less convepti.onal formats of ques- 
tions^ 5^8. One test of .that hypothesis would be to examine the difference in correlations 
of APl-4 and AP5-8 cla&s average scores on pretest with the STEP class 
average pretest scores. If the correlations^ are significantly different/ and if 
the APl-4 pretest class averages correlate more highly, there would be sup- 
port for the hypothesis. The correlation coefficients for the pretes,ts for the 
total group of classes (MACOS and non-MACOS) were used, on the assumption 
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that there was na reason to regard MACOS and non-MACOS classes as dif- 
ferent with respect to the AP pretest. The corrrelations were: 
' ' STEP and API -4: r 771 (N = 106) 

\ . ' * ^ . * 

STEP and AP5-8: r=. 645 (N= 106)' 

APl-4 and AP5-8:J^* f. 582(N= 108) 

The t-test for thq^ significance of difference between dependent corre- 

lations was significant ( t = 2.372, df 103, p^. 05) >3 it' was concluded that 

APl-4 class average scores correlate significantly more^highly with STEP 

pretest class average scores than AP5-8 class average scores. 

It is also possible, of course, ^that average reading level of the class ^ 

was a factor. Therefore, similar test was made of the correlations- of APl-4 

> • "* 

and AP5-8 pretest averages and>class average reading level (measured on a 5 

44 ^ ' 

point scale). The correlations were:: , . • 

[ . Reading and APi-4: r= -. 525 (N =107)^ 

Readinrand AP 5-8:r= -.448 (N= 107) .. 

AP1t-4 and AP5-8 pretest .class scores did. not correlate significantly differently 

with class average reading level (t = -.354, df = 103, p>; . 05). Thus, there 

appears to be some support for the hypothesisjhat ability of a group to handle 

general achievemejtit test types of items maybe more influential, even in the 

AP5-8 questions, than pretest performance peruse, andfthat APl-4 is tapping 

43^. The computatipnal formula is that given by Cohen jind Cohen. See: 
Cohen, Jacob, and Cohen, Patricia, Applied Multiple Regression / 
Correlation Analysis for the Behavioral Sciences. Hillsdale, N.J. : 

Lawrence Erlbaum Assoc. , Publishers, 1975, page 53. 

^ • t.* 

44 . The reading variable was scaled such that the higher the scale value, 
the lower the class average reading level. The correlation of reading 
. level with STEP pre was 693. 

" ' ' . ^ ' IIMll 
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• that ability. Even if the correlations o°f the three variables have class average 
reading level partialled put, the differences in partial correlations of J\Pl-4 

and AP5-8 class average pretest scores with class average STEP pretest. 

* scores are still significant (t = 2.091, df= 103, p^"^05)/5 ' ' 

From the preceeding analyses, it is concluded^that:- 

. although the Man and'Animals part, of AP does differentiate . 
between MACOS 3nd hon-MACOS jclasses (e.g., MACOS 
classes scored higher. on API -4, on the:averager than non- 
. - , MAC OS classes in Follow-up 2); it has more of.the charac- 
^' teristics of a standardized achievement testr(the STEP test) v 
. ' than the Netsilik p^rt of the test (AP5^8); * - 

/pretest class aVej?ag^e scores and.percentage of 5th grade 
' • students (esis^ptialljr, the average age of the class) are 

more important predictors of posttest and Follow-up 2. 
class average scores for API -4 than the percentage of 
Man and Animals lessons completed within the group of 
MACOS classes; 

.how a class scored on^i^l-4 pretest and the percentage of 
Netstlik lessons^'compiet^^re the more important predictors 
of posttest perfdrmance on the Netsilik questions (AP5-8) 

.whether MACOS teachers used some or all of the AP items 
with their classes during the year has. little influence qn post- 
test om either part of tlie instrument ox on follpw-up class 
average scores. :^ 




45. The partial correlation coefficients are: 
STEP and APl-4: . 62 
rj -\ STEP and AP5-8: .. 46 . 
^ , APl-4 and AP5-8; .44 
f." _ * • 
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3) Item Responses for the Questiongalre About Aninaals and People (AP) 
. The preceding analyses have focussed on relationships of amount of 
implementation to performance on the MACOS content questionnaire. Since 
that instrument, ,of all those used, consistently differentiated between^MACOS 
and i\on-MACOS classes, as would be hoped, it Is of interest to examine Item 
responses made by MACOS and non-MACOS students.. In some instances it is' 
evident where MACOS students in particular did and did not end witH a clear 

grasp of somq parts of the coui^se as reflected in the itenis. 

' *' _ "J ■ • , ^ 

For each itenxjand choice, t'ables showing the percentag^es of MACOS 

.> ■ ■ ; 

and' non-MACOS students ( the student as the unit of counting, no{; the. class ) 

■ . • • • 

choosing each alternative in the posttest of the questionnaire were prepared. 

These item analyses are given in Table HI-Sl, whi'ch shows each question 

^nd item, and the percentages of associated responses^ In examining the itei|is 

and item responses, it must be remembered thatrl/the individual responses 

came from groups of students who had been in the same classes; 2) as shown 

*^ * - " 

above, there was a range of implementation oi both units among MACOS classes, 

: ■ • ■■ ■ . ■ ~ ' ■ • ■ „ ' 

and 3) the item distributions combine responses from 5th and 6th graders. With 
those qualifications, it is believed.nevertheless that two further statistics will^ 
aid in examining items. One is the p-value of the Chi-square test of the signi- 
ficance of the difference between groups of the total response distributions for 
each item. The other statistic is the .asymmetric lambda A ( XA), with group 
(MACOS, non-]VLACOS)'as the dependent variable. This statistic, as described' 

46 . Thedte^ response distributions pertain only to students who responded 

„ they do'not include percentages of students who omitted the item. 
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earlier, is ^ald ln.malntafning a persp^tive on the strength ofN^redictlvfe 
association between differences in response distributiqns between the^^o 
groups. It I's tfie percent reduction in error of prediction of group membei-shiPr 
given resppnses to an item. One may find, for example, a significant chi-squar€i^ 
but little predictive association. Lambda A ( AA) thus provides ^ guide to 
Interpreting chi-square p- values. 

Sample sizes are not included in the tables to^save sgaceT They vary 
In each'group, depending on the specific item.* The following are the mean 
sample sizes, standard deviations, and actual maximum and minimum sample 
sizes for each group: ' 



MACOS 
Non-MACOS 



^ \ 



M- ' Max Min. 

606.13 11.42^ 621 . 577 
547.93 13.86 ^ 570 524 



On occasion* comparisons will be made with results obtained in the 
Normative evaluation of MACOS.^'^ Item analyses of posttest (winter 1968) results 
were algo made In that evaluation. In some cases results for MACOS students are 
similar to those obtained in the present study; in some cases they are quite dif- 
ferent. There are several possible reasons for differences. One of course Is 
that in some dases item wording and formatting were different in this study. An- . 
other Is that the demographic characteristics of students (especlsTlly % 5th grade'^and 
% 6th grade) were different In the 1968 EDC formative evaluation study than in . 
' this one. The EDC study had more 5th graders, fewer thjradfirs^-it-^ate^-fet^ 7" 



-gonfeltli graders. Yet another, possible reason Is that programs were Impleiriented 



47 . Hanley, Janet P. , et. al. , Curiosity/Competence/Community: An Evaluation" 
. of Man:A Course of Study . Soclarstudies Curriculum Program, Education 
' Development Center, Inc., Cambridge, Mass., 1970, v^ol. I, Section III. 
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differently in the tw'o studies. This report has already shovyn that there wpre 
wide Variations in implementation of the curriculum. The EDC report note's 



variations in implementation also. However, it does not give indication of the 
extent of variatiop found in the present study.. Another posisible reason for 

' m 

-A 

. - _ . ♦ S - 

N - 

differences *for the Maa aad Other, Animals part of AP Xs that the EDC posttest 
was giyen at the end at the end of the unit (^'inter, 1968); in this study it was 
given-near the end of the year (May,1975),. typically a semester after the unit, . 
There are,of course^ other possible reasons for dffferences in results. 
1) Question 1 - , ' 

This question was described by EDC as related to the "ability to make 
comparisons and distinctions between man and other animals."'*^ Five of the 
item's (a.b.c.d, e - the latter niodified in wording) are from the original instfui: . 
' ment. The last "four are not.' Of the original five, the first two differentiate 
between MAC OS and non-MACOS groups, although the indie ies of predictive* 
association are small. The pejrcentages of correct responses of the MAC'OS 

" \ - ^ ■ - : ■■ ■ 

students for item a Iffl^arry) are a little lower in the present study, compared to 
the EDC 1968 formative evaluation (S0% in the present study compared to 90% " " 
for EDC); they are suB^antially lower for item b,, (grow up without adult care: 
52% coinpared to 81%). \\,^TCi h (use a language) is probably the most interesting 
item in the whole set. Th^MACOS materials emphasize the fundamental difference 
between animal communicatitm aiid human language. The course stresses language 
as one of the major shaping forbes orhuman beings. Here there was no significant 
differentiation between groups in l<espons\.distributions. There was a marked difference 
48. Ibid. , p. ni-1. . , 




Table 31 

A Questiobaaire About Animals anS People 



1. / la. the list below are 9 things that happen during the lifetimes of human beings 
j or other anjimals. Some things happen just to human beings; some happen 
f to other animals ^t not to human beings. On the line beside each question, 

^ 1 write a ^ , 

j 1 If it is true only for human beings ' ■ ^ ^ 



2 if it is true only for, some other animals 

3 if it is true for both hunian beings and some other animals 



1 - 




1 


2 


3 


marry 


MACOS 


80. 0*70 


1. 6/t) 


18.47b 




Non-MACOS 

• '• 


77i5* 


.4 

• 


22.2 


grow up without adult 


MACOS 


3.9 


51.5* 


44.6 


care/ ' 


Non-MACdS 


3".0 


44.9* , 


52.1 • 


* 

use a language - . 


MACOS" 


36. 6* 


4.-a 


59.2 




. , Non-MACOS 


33. 0* 


-5.6 


61.3 


protect themselves 


MACOS 


3.1 


5.6 ^ 


91.3* 


from enemies 


' Non-MACOS 


3.5 


7.7^ 


88. 7*- 


cooperate with each 


, MACOS 


16.1 


5.2 


7fr.7* 


other 


Non-MACOS 


17.4 


5.9 


76.8* 


have belief systems 


MACOS 


64.3* 


7.5, _ 


28.2 




Non-MACOS 


60,7* 


8.6 


30.6 


throw things 


MACOS 


■ 32.0 


8.8 


59.2* 




' . Non-MACOS 


40.9 


7.3 


51.9* 


have a social 


MACOS 


62.8 


6.7 


:jo.5* . 


organization 


Non-MACOS 


'64.1 


7.7 


28.3* 


make symbols 


MACOS 


. 50.6* 


8.7 , 


.40.8 




• Non-MACOS 


57.1* 


9.7 


33.8 



answer scored,as Qorrect. , 
p-value of Chl-square. , 
Lambda A: index of predictive association of 




1/ 



.029 



.033 
.287 
.306. 
.722 
.435 
.007 
.625 
.030 



from responses. 
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* . ... ' . ' " Table ni -SI CT)tttinued . 

• ?. . During theii^lifetlmes, animals learn' to do many things: They are 
. • able to do* other things without learning s" Read each sentence below. 
Then check one answer for each sentc-nce showing whether or not you 
think the animal must learn the behavior or do it without learning. 

^ Herring Gull (A Bird) " ; ' . . o 1/ \k2/ 

• • ^1 ' . -.MAC OS Non-MACOS x'' - 

, t> — 

. find the edpoa of its territory . , • ■ . ' „ 

* 1 . Learns to find them ' ' ^ 68.9% 62.2% ' .018 ' 4. 
2. -Does not have to learn to find them 31. 1 37. 8 

b. crouch when in danger * ' 

1 . Learns to do it / 37.3 . 44.4 .015 4 
*/ 2 . Does . not have to learn to do it - 62. 7 55. 6 

. 'Recognize Its.chicks by spots on the ^ / , ^ 

head ^ • . . ' 

* 1. Learng to recognize them 48. 6 51. 4 . 925 0 

2 . Does not have to learn to recog- 51. 0 49. 0 
; nizethem 

Baboon (A Mammal) * . 

d. know the alarm calls of other animals , . * 

* 1 , ; Learns to know them 58.2 67. 1 . 002 4 
2. Does not have to learn to l^now them 41.8 32. 9 . 

e. make sounds > ■ . 

^1, Learns to make them : 30.9 38. 4. .008- 5 

* 2 . Does not have to learn to make them 69. 1 6i. 6 

f. , know its pl^ce in the dominance order . * . . 

of the troop ' . ^ 

* * * 

. * 1. Lg^ns'lt '" ' ' 72.3 69.4' .290.'' 'o 

____2. Does ncrt; iiave to learn it 27.7' ^30.6 

* • A ■ : ' 

* = answer scored correct. 

1. p-value'of Chi-square. • . - 

2. Lambda A: ihdex of predictive" association of group from responses. 
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• • Table III- 31 Continued 

s! Beside each sentence' in Column A, write in the-number of the 
• sentence from Column B which* you think is the best answer. 
You sl^ould use an answer only once. • , 



B 



_i_a. 
_J).- 

c. 

d. 



?. desc/ription of a structure" 
a description of a function 
an example of dominance 
an example pf learned behavior 



1. The water is cold. 

2. The puppy moved back "from the 
^ food bowl when the adult male 

. ca'me toward it. 

3. The icQ kept the lemonade cold. 

4. Herring gulls parents recognize their 

chicks by the spots on their heads. 

o 

5. She i's pretty. * s " 

6. " A tree has roots, a trunk, branches ' 













and- leaves. 


1> 




"Questions Group 


1 


Answers . 
2 3 


4 


5 


6 ' 


x2-pl/' 


:Xa2/ 


a. -MAC OS 

Non-MACOS 


, 10.7% 
M. 5% ■ 


5. 3- 

- 7.2 


7.8 
8.7 


8.7, 
7.7 


•14.5 
. 9.6 


53.0* . 
52.4* 


.056 


4 < 


b. MACOS 

Non-MACOS . 


11.7 . 
9.3 


15.0 
20.6 


38.8*. 
33. 1*-; 


14.8 
19.3 


*6.B, 

i 6. «i 


12.9 

...11.4. 


.022' 


7 . 


c. MACOS 
Non-MACOS 


.7.8 . 
ll.O 


53. 3*. 
18.6* 


10; 6 
19.6 


14.0 
26.6 


10.2 ' 
'^6.5 


4.1.. 
7.6 


.000" 


29 


d. MACOS 
Non-MACOS 


. 8.1 
5.7 


20.9 
43.8 


8.2 
5.9 


48.^* 
27." 8* 


, .8.2 
8.8 


- 6.3 
8.0 


.000 


22 



* = answer scored as correct. . * : 

1. p-^value of-Chi-square. - ' ' 

2; Lambda Vi: index of predictive association of group from fesgonses. 
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Table nl-31 C OQtinued 

' 4* On the Itae beside each word, write the number' of the definition that hest 
describes that word^ You should use an answer only once/ * 



^a. life cycle 

lb/, offspring 

c. Juvenile 

d; reproduction 
' e. human being 



. a'young human or other young animal 

2. " a mammal and a primate . V 

3. giving birth tQ young, ' 

" , 4^ the youngf of any anlfcal ^ 

5. the ptittern of being born, having babies, 
dying ^ 



'Tjwxlirtironc'^id^ 



7^ a delinquent or bad teenager* 
8. the'qjposite of animal 



Ajjswers 



^Questions Group ' 
a; MAC OS 

Noh-MACOS. 

b. MACOS o 
Non-MACOS 

c. -. MACOS ' 

Nop-MACOS 



7* 8' IxHl^Xfi^^ 



9.3%' 4.5 6.2 2,2 73.9* l."7 



,8 



14.9% 4.7 10.7, ' 3.'2 62.0* 2.4 1.'3 



1.3 
.8 



15.0 . 7.4 24.1' 41.5* '4.1 5.0'^ 1'. 7 
16.5 10.3 15.3 33.9*' 3.8 15.71 1.7 
2.0 14.9 



.^01 

* 



10 



1.2 

2.. 7 



.000 14 



36.3* . 6.0 

13. 3* 6.9 4'..8 '6.9 



3.9 2.0 33.0 1.8 
3.3 4. 6 o 58. 5 1. 7 



.000 27 



d. .MACOS 6.4 
•Non-MACOS. , 5.9 



9.4 57.5* ' 7,8 -6.6 5.2 3:5' 3:6 
5.9 50.8* '^.'8 15.8 5.3 4.8 3.6 



.000 10 - 



e. MACOS 
Non-MACOS 



5.9 14.'9* 3.1. 2.2 3..2 
8.6 15.9* 3.6. 1.9- 3.& 



■3;1 * 5.6 62. Ov 
1.9 2.4 62.2 



,106 



*?=' answer scored as correct., * 
lC. p-value of Chi-s'quare. . ' 

2. Lambda A: index of predictive association, of group from responses. 
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Table III-31 Contiaued 



5. Several statements about the Netsillk Eskiinos are listed below.' A\'hat 

do you think each of the following things depend upon? You may decide ^ 
that more than one. answer could be given, but check only one answer for 
■, eacli^statement. If you aren't sure, make a guess. 



1. the kind of songs 
' the Netsillk Eski.- MAC OS 
mos make up " jNon-MACOS 



Depends Depends upon Depends upon 

upon rules what a' person wliat a person . _ --- 

of Netsillk prefers is able to do X^pi ' p^- 

society ' , . ' . 



33; 470. 
27.1% 



47.0* 
51.3* 



19.6 
21.6 



.065- 



2. the Netsiliks' use = MACOS 



of magic and 
other 43 eU'efs 



Non-MACOS 



66'. 0* , 
56.6* 



17.4 
22.7 



16. 
20. 



,005 



3. 



the activities ' 
connected with 
the birth of a 
Netsillk baby 



MACOS 
Non-MACOS 



51.1* 
37. 2 * 



23.2 
29.7 



25 
33 



.000 



4. the friends 
< Netsilik 
children make 



MACOS 
Non-MACdS 



18.0 
19.5 



66.4* 
61.5'*' 



15. 

,19. 



,180 



5. choo^'in^a song MACOS • 16.9 
partner . Non-MACOS 16. 1 



66.6* 
63. 4* 



17. 
19. 



,487 



6. surviving through MACOS 1^.4* 16.4 
a hard Arctic . .Non-MACOS". 22.1* - 16.4 
, winter . 



/ 



66. 
61. 



,122 



the Netsilik* 
Eskimos who 
act as leaders 



MACOS 
Non-MACOS 



50.0. 
53.7 



16.4 
20.5 



/ 



33. 
25. 



6* 
8* 



,011 



• .... ' ■ . ■ • / ' 

' =answer scored as correct. - • / , 

1. p-value of Chi-square. - / , ^ 

2. Lambda A: index of ptedictive association of group from responses. 
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' , Table III- 31 Continued 

^6. If a group of Netslllk Eskimos came to visit us, some things about 
» our .lives would #eem familiar to them. Other things would seem- 

different and strange or unfamiliar. 

For each of the phrases below check whether you think the Eskimos 
, - would find it familiar and similar to their way of life, or different 
and unfamiliar to'tHem. \ 

' ^ . 2 1/ 

a. the fact that we use words to repress MAC OS Non-MAC06 X-fiT 

our feelings and ideas 

♦ 1 , similar, familiar - ' 64.2^ 62.9% " .691 
2, different, unfamiliar 35. 8 ' 37. 1 

b. the fact that different rooma in'our 
houses have different functions ,(f6r 

' example, we use one roam foi' cooklne:, . 
another room for sleeping) . ' 



1. similar, familiar 



28.2 ^ 29.2 .'743 



/ '2 . different, unfamiliar , 71. 8 70. 8 - . 

G. the way we feel when a friend makes 
fun of us 

similar, familiar " 67.4 70.0 " .365 

2'. different, unfamiliar . ^ 32.6 30.0 



41.8 58.7 .000 



d. ^ the way most of us feel about dogs 

1. similiar, familiar 

2 . different,^ unfamiliar 58. 2 '41. 3 

e. the fact that our parents tell stories ^ ' 
to us when w6 are young 



1. similar, familiar 



77; 2 72.1 .054 



2. different, unfamiliar 22. 8 - 27. 9 



t :the fact that we often throw away 
unwanted objects or food 

1., similiar, familiar 



25.7 30.7 ' .065 



2 . different, unfamiliar . 74.3 69.3 

*answer scored as correct. 

1. p-value of Chi-square 

2. Lambda A: index of predictive association of group from responses. 
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Table ITI-31 ConUnued 



" 7* Both Netsilik Eskimos and wolves hunt the caribou on the tundra. Below 
is a description of a hunter. Read the descriptibn and decide whether • 
fthe hunter is a wolf, a Netsilik Eskimo or whether it could be either one. 

' ^ I sometimes Hunt alone, but I often hunt in small groups. 

I often chase caribou towards others of my kind in hiding. 
I plan on using different methods for catching caribou 
depending on whether I hunt the caribou on land or in the 
water. Some of iny kind may die during the year if not 
enough caribou are killedi 

What am I? (Check the one best answer.)' 

«. ' - 0. 

• , MAC 06 ■ Non-MACOS 

1. a Netsilik- Eskimo - - . 34.7*% 21.0*% ; 

2/' a wolf . ; 18.1, 26.9 

3. the hunter could be either a Netsilik 47. 3 52.0 
Eskimo or a wolf • ^ - 

What was your reason for the answer ^ou chose above? (Check the one feest answer) 

1. both Netsilik Eskimos and wolves 

do all the things listed above 

2. both Netsilik and wolves 
cooperate in hunting , 

3. only man can plan which hunting 

methods will be most useful in 
a. particular place 

4. only- wolves hunt jn groups and 

chase caribou toward others of 
' their'kind in hiding^ 

♦Answer scored as correct. 
1.. p-value of Chi-square. 

2. Lambda A: index of^predictive assoetation of group from responses. 



.000 7- 



39.4% . 42.6% .001^ 3 



21.0 



23.4 



28. 3^ 



18.3* 



11.3 



15.7 
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Table 111-31 Continued 



8. The Netsilik do some-tKings mainly to meet needs of daily survival 
(physical needs). Xhey do other things mainly to help explain anS 
give meaning to their world, to.feel more comfortable about life 
(spiritual needs). .Think about whether the 'following activities^ 
meet mainly physical or mainly spiritual needs> Then check either 
physical or spiritual. ^ , - 

' * , . ^ WTACOSr Non-MACOS X^pl/Mi/ 

a. The Eskimo woman covers the eyes of a fish with ' T 
ashei^* 

. 1. physical ' 14.2% 24.8% .000 9 

2 . .spiritual • ' 

b? At the river camp the men first repair the weir 



14.2% 
85.8 . 



At the river camp tne men iirst repair tne weir 
(a trap made of stones to catch fish), which was 
damaged by winter ice. 



^ 1." physical- 

2. spiritual 



78.3 
21.7 



24.8% 
75.2 



75.5 
24.5 



.293 



c. The men -are very careful not to repair their 
tools near the stone weir 



1. physical 
_2. spiritual 



d. A youni' hunter makes -up a beautiful song about 
the g^eat caribou he is going to catch. 



1 . physical' 
* 2 . spiritual 



27.1 
72.9 



30.8 
69.2 



'e. 



23.4 
76.6 



57:9 
42.1 



44.1 
55. 9 



000 14 



31.2 
68.8 



40.0 
60.0 



A careful Eskimo always drips fresh water^into 
a seal's mouth after it- has been caught. 
* ' 
. 1. physical . 

* 2 . spiritual ' r 

f. A^ man can borrow the wife of his song partner 
when his own wife is unable to travel with him. 

* 1 >- physical 
2. spiritual 

♦Answer scpreci as correct. 
1. p- value of Chi -square. 

2.. Lambda A: index of predictive association of group from responses. 
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43.4 

56.6 



.942 0 



.000 ^.14 



,000 10 



In percehtage of correct responses between the MACOS students .In this studyandthe 
ones- in the EDG iformative evaluation (37% in this study compared to 76% in the 
EDO 1968 national pilot study). MACOS and non-MACOS students in this study 
chose right and other responses at virtually identical rates. Item 1 (make symbols) 
in question 1 was added as a further check on the question of the distinction between^ 
language and signalling or communications. The terms 'create' or 'use' were 
considered in lieu of 'make'. It was believed that 'make', for 10-12 year olds, 
came <ilosest to Uie distinctions being drawn between language and communications 
in MACOS. Here the item did differentiate slightly between MACOS-and non-MACOS 
students, jvith non-MACOS students having a higher percentage of correct responses. 

' MACOS students, on the other hand, .did appear to be the rtipre knowledge- 
able about animal behavior .and capabilities. Item g (throwing things) differentiated 

the most strongly of all items in the set between groups, in favor of MACOS students. 

J • ,j . — ... . '*','.. 

It is not a specific item of MACOS written content- DeVore's journal makes.no 

- : ■ • y\ 

reference to.it , no teacher's manual makes reference to it. The students' book- 
lets on baboons, chimpanzees, animals of the African Savannah, and others make 
no reference to it. Possibly MACOS s.tadents were more attentive to some animal. 

T.V. programs. - ... . , 

One' item in question 1 over which there may be contention about the scor-. 
ing is'item h, 'have a social organization'. Bruner stressed social organization 
as a major humanizing shaping force. The MACOS student materials do not refer 
to animals having a social organization. They refer to troops, dominance, offspring, 
parent dependency, functions of animals in groups according to sex, age, aggresiveness 




and so on. The teacher's booklet on baboons explicitly refers to the social 
O3%anization of troops of baboons. De Vore's article "Prim?(te Social Life" in 

Seminars for Teachers ( a MACOS teachers' booklet) refers more than once ^ 
to the "social organization of baboon troops". De Vore, in his article, however, 
is careful to draw distinctions between human and animal social organization on a 
number of dimensions. The concept, in the MACOS materials, seems ambiguous. 
The dscriminandumappears.tobethat human beings can vary their^ social organi- 
zation (relationshipsV; aninaals cannot, once they mature sufficiently to become 
iactive and reactive members of a.species-specific group. Rebel baboons cannot, 
one is led to believe, change the fact of donfinance structures within baboon troopr; 
Rebel human beings may bring about a sequence of events that fundamentally alters . 
. dominance relationships (and others) between inter and intra -societal groups (e.g. , 
tfie American Revolution). The forces operating are cultural, religious, economic, 
racial, or what ever,. but not genetic. 

Thebellef of this project w^as that the concept of social organization (a ^ 
lack of purely individualistic or <randbm behavior) was inherent in MACOS materials 
to teachers, if not totstudents. It was for that reason, assuming teachers noted 
the same thing, accepted it, and taught it,, that item h was scored as it was. 
's^ 2) Question 2 

The wording of thi§ question and the response format was modified in an 
effort to make it easier for poor readers. The change in response format did intro- 
' duce ambiguity, as was pointed jSut by some studentsl For example, the choice ''does 

not have to learn to do it' can mean: 1) is able to do it without learning h6\x to, or 

♦ 
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2) has no need to do iU The instructions for the question, however, are not 

ambiguous^ The effect of ambiguity in response choice for the itern^, if one 

were uncertain about the concept (learned vs» Innate behavior), or the instructions, 

or both, may be to make responses random. For the sample sizes involved 

here, ttie 95% upper and lower confidence limits for accepting the hypbthesis 

^that an observed percentage of correct responses is not different from 50% are: 

1) for the MAC OS group about 45-55%; 2) for the opn-MACOS group 44-56%. Jhere 

is one case in which the distribution for MAC OS students fall within those limits 

(item c), and two cases for the noa-MACOS students (items b and c). ' Other- 

wise, all, distributions for both groups show percentage3 ol correct responses 

» * ' 

significantly different from chance,^ 

« • * ** # * 

' * *" • . . • - ♦ 

/ ^ Of the four'ttems for' whitsh the Chi-square for the difference between 
.groups was significant at the\05 level, three (a, b and c) show the MACOS students* 
having higher percentages of right answers. Curiously, for item d (baboons, know 
the alarm calls of other animals), the non-MACOS students had the greater per- 
centag6 of right answers. The percentages for the MACOS students on posttest 
for this question are very close to those found on posttest in the EDC study. The 
fomative evaluators noted that, aalong with t^e concept of language, applying the 
concept of learned versus innate behavior by identifying examples of^ach in herring 
gull and baboon behaviors was a problem area,^^ Waile 60-70%^f the MACOS 
students got mpst^of these items right, obviously 3b-^G%/md not. However, a 
similar range of non-MACOS students also got fouimit of six of the items fight. 
The. average difference between groups in percentage of right answers for the three 
49. Ibid> , p.-III-li; ' " ' 
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Items in which percentages exceeded chance and MACOS had the higher percentage 
is about 6%. As one can s.ee in the table, while differences are significant, the ' 
streith^ of predictive association indices ( XA) for the items are not very large 
(4-5% reductions -of errors in predicting groups,from responses). The course 
does give MACOS students on the whole an edge over non-MACOS students in 
'ability to identify learned and inhate behaviors, but- it is not a- large edg^ as 
measured by this question. . , . * " -. e . • ' 

3) Question 3 ■ ^" „ / 

appearing in the MACOS Evaluation Strategies booklet, was 
modified slightly. Response option 2 in Column B wa3 changed from an example 
of baboon dominance behavior to dominance among dogs in order to test the ability 
of MACOS students to transfer a concept to another species. The instructions also 
included a statement to use an answer only once, .^ile the MACOS formative 
evaiuators, Jn cdmmenting on a matching question, noted that instructions did not 
make it clear to students that an answer could be used more than once, the MACOS 
Evaluation Strategies booklet pro>^ides a key of single, presumably pjeferred.choici 
' for that question (modified) and for question 3 here. It therefore seemed appro- 
priate that students should be told that. 

Overall distributions of responses by'the two groups did differentiate be- 

^ ~ — — . n 

.tween them, more strongly for items b, c,.and d than any of the items in tlie prior 
two questions. It can be seen, however, in the table accompanying question 3, ^ 
* that with respect to "right" answers,, the concepts of structure and function (items 
a and b), non-MACOS students did about as. well as MACOS students. MACOS stu- 
dents clearly had a strong edge over nonrMACOS students in recognizing examples 
*of dominance and learned behavior (Items c^and d). However, 'within the MACOS 



group,, the percentages of students correctly Identifying the examplegi^are only 
around 50%. Basefrfon this form of assessment, the data provide further indica- 
tion that the more complex and abstract concepts were not in general learned'' 
effectively. . ^ ' . ' . ^ 

4) Question 4 ' . 

♦ 

This is another matching question, testing use of course vocabulary. 
Foui* of the five items (a-d) show strong differentiations between the two groups * 
of students, -with MACOS students showing the'hi^er percentages of correct choices. 
'With the exception of item a (life cycle), however, the percentages of correct^ 
• choices MACOS students are not high. They are substantially lower than this 
postt est percentages of righf responses found in EDG^s format]v6 evaluation. 
Item e (human being) was answered correctly, ,a^\defined by the MACDS scoring 
key, by only 15% of the MACOS students. They, like non-MACOS students, pre-^ ; 
dominantly chose the definition 'the opposite of animal' for that tdrm rather than 
' a mdfmmal and^ primate'. The percientage^ of correct responses for that item 
in the EDC evaluation was also low (32%), but not as low as fbund in this study. 

5) Question 5 . - ' 

This IS the first of three questions on the Net^ilik unit' of MACOS. It 
asks^ students to classify behaviors according to. whether they are most likely to 

A .... - ^ ^ 

depend on: 1) the rules of Netsilik society; 2) what a person prefers; or 3) what a 
.person is able to do. Three of the six items (2, 3, and 7) show a significant dif- 
. ferentiation between MACOS^nd non-MACOS students on posttest." Three do not. 

In the three cases in which there is a differentiation, MACOS students have the 
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higher percentages of correct responses, indicating naore concrete knowledge 
(or.understandiDg| of some reasons for certain specific behaviors* The Indices 
of predictive assciciation, howevet, for those three items were not very large, . 
compared to other questions and items. Nevertheless, they were associated 
with significant differences between groups. Again it can be noted that the range 
•of MACOS percentages of "right" responses is about 14-67%. 

6) Question 6 ^ . ' 

This question explores understanding of NetsiUk culture and its slmi- - 
larities arid differences from ours. It asks students to indicate whether they 
'thought that if a group of .Netsilik Esl;im9s came to visit.them, they would find ^ 
certain structures, functions or attitudes similar or familter to theirs, or dif- 
ferent and unfamiliar. In this question, the response format was modified to 

make it more intelligible to a wider range of students than the original formats. 

' -I . ' . " 

Otherwise, items remain the same. - ' ^ 

The two items that significantly differentiate between groups are: 1) J:he 
way most of us feel about dogs; and 2) the fact that our parents tell us "stories o 

when we are young. The other four items were answered correctly by non-MACOS 

/ 50 ■ . 

students as frequently as by MACOS students. None of the distributions in 

■ - either group fell within the limiti) of chance. . < ♦ ' ' *- . 

. ' 7) Question 7 

These two items were intended to measure the ability of students to 

—^^reason from evidence based on knowledge gained fri.m the course. There is no 

i ' ' ' . '> ^ 

'50. It should be noted that Eskimos as a general cultural groUp were hardly 
^unknown to many non-?-MACOS students. 

SI ' ' * . 
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question, that MAC OS students do better with them on posttest than the non-MACOS 
group,l)ut the percentage of MACpS students giving correct responses to both 
parta of the question is a minority of the total group (35% to the first part of the 
question; 28% to the second part). ' . 
■ . . • 8) Question; 8 - . 

This is a set of six Items designed to assess students' understanding of 

' - ' ' ' ' " 

the reasons for certain behaviors of the Netsilik Eskimos. It asks students to 

differentiate between physical and spiritual reasons. underlying certain customs 

and behaviors. ^ ^ ■ - • 

It can be seen that except for the non-MACOS group for item c, proportions 

of correct responses are different.from chance.51 It may be concluded that: 1) in four 

of the six items MACOS students answered the question correctly significantly more 

often than non-RIACOS students; 2) on the 4 items (a, c^, e, and OjMACOS students got 

correctresponses an average of 17% moire often than non-MACOS students;, 

\ 3^,the indices of predictive association range from 9-14%; and 4) the items of 

question 8 were in all cases answered correctly by the majority of MAC OS stud6nts, 

1 \ The analyses of individual questions and item choices suggest several 

Implications about MACOS, its implementation and effects, as measured by the 

questionnaire and procedures of this study. Students do learn many things about 

animals, animal behavior, reas^ons for behavior,. Netsilik customs- and reasons 

underlying them; and they do acquire and apply a vocabulary. There is indication as 

f . . \ ' . \- ■ - , ■ .. • . 

noted above, however,, that some of the more difficult concepts of the course, 

51. Consider MACpS two-tailed 95% confidence limits to be 45-55% and non- 

. MACOS ones o'f'44-56%i These confidence bands upply to observed item 

\ ' ■ ■ ■ • 

sample sizes. \ . 
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siich'as the distinction between anirnal cbmmunicatioii and human language, 
are not getting aerdss effectively. For example, quesflon 1, item c, concerning 
whether. animals as wpll as human beings use a language, not only did not dlf- 
ferentiate between MACC^ and non-MACOS students, out also was answered 
correctly by slightly over one-third of the MACOS students. Theyoncepts of 
structure and function are others that, given this questionnaire as a means of 
assessing comprehension, were difficult concepts for many students. Further, 
as noted above In connectlon^with question 4, Item, e,' the majOrltj^ of MACOS 

*' * " " r 

I 

as well as non-MACOS students on posttest identified ",human being" as "the 
- opposite of animal". Finally, w^h respect to questiojn 7, while proportionately 

more MA^OS students tjian non-MACpS were able to recognize the concept of • 

„'. • . ' / ■ ■ 

planning ahead in relatiojn to circifenstSnces as a difference between animal > 
hunters (wolves) and huriian hunters (Netsilik Eskimos), the majority did not 
perceive it*as it was expressed In the^uestion. . ^ 

Students in this study appeared to do best with factual material or with 
conc^;pts for which.there wdre readily observable or describable examples. The 



' concept V dominance is example, life cycle is another, Simjlarl^ 4nost 
students .^n^sped the fact that some customs or behaviors of the Ne^ilik were 
based on certain beliefs about, the world, or on spiritual needs as distinct from 
necessity (see e.g. , question^S^) ,\ , . ' . ^ 

While these analyses raise questions about the difficulty level of some 
of the cour5:c concepts and iriatePial for 10-12 year olds,. several factors must 
be considered in tempering inferences and generalizations.1 One has already been 
' stated' there was a wide range of amount of implementation of the course 

.' III-131 • ■ V 
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In the MAC06 classes in thls study. Some of the variations in performanfcV.on 

• ■ , . " ■ . . ' • 

particular questions and iteln^ may simply reflect variations in impleinenta|lon; ^ ^ 
It has already been found that total scor'es for the Netsillk questions (AP 5-S) . 

' - • ■ • - •;. '• . ■ ■ 

Were significantly associated with percentage'of Netsillk lessons coter.ed (see . 
Table in- 30 ).52 Second, th? forSiMn which questlons'and responses about . 
abstract concepts was put may work -tto'restf let "^he ablUty of students to dc^pion-^ " 
strate.grasp and mastery of cjoim>lex or . abstract xsoncepts* -The questionnaire, 
like air such Instruments, puts a h^vy reliance on reiadlng ability. Ambiguity of 
questions ihay have been a factor ilnfluenclng choices. Furthermore, this form 
otjiessment of knowledge and-skiUs was'found s.ometlmes to be disliked and 
'resisted by-students. It was the experience pf staff membgrs of this project 
that ellcitinfe I'nformatlon, descriptions an(\, explanations from students In interview 

■ • . ■ . - 

'ssltuations was often a more felicitous situation, judging from students' reactions, 

. ' ' ' % ' ' 

than administering the various fo'rms,' even when the latter were read aloud. 
Third, ,the instrument (AP) was admifilstered last to students <follQWing Study 

^ 0 • • 

Choices - SS Ch, What Would You Thinlf -(WA and B, andTjAPS)- The responses 
m^y reflect a. fatigue effect both in MACCB arid non-MACOS groups. ^ 

n. Si' 

There are other possible reasons thpt could account for or contribute 
' to^he relatively poor posttest performance^of MACOS students, on the^l^rage, 
with some of the question's and items dealing with concepts and distinctions in the 
course.. .Nevertheless, the trend of results obtained in this study, particularly 
with respect to coftcepts such as language, and learned and innate behavior, is 

52. MACOS formaWve evaluators found similar results. . Cf. Hanley, Oe._cit. , 
- p. mr31. * - ' • 
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Similar to that^^?)und in the formative evaluation of MACJ0S.53 The c&nsistencyr . 
of trends raises the question of agfe appropriateness of some of the naaterials ^ - ; 
and subject matter. It'has been'seen that with respect to the Man and aher 
Animals questions (AP 1-4), when the clas^ average sco^e is used, air the measure, 
the percentage of 5th graders in the class is a significant predictor of total sqorc 
■ (cf. Table in- 30). The higher the percentage of 5th graders, the lower the pre- ^ 
Vdicted posttest score for the class. That is not the^case for the Netsilik p^rt (AP5-8). 



If is the first part (AP l-4) of the' overall questionnaire that contains the questions 
on some of the more ,difficult:concepts such as language, ' learned behavior, 
strifcture. function, human* being, eto. ' k. * 

The conclusion is not that 5th grade studeriis are incapable^of learning' - 

* , • } , * 

such concepts and demonstrattng*it by being able to answer questions about them ^ 

in the format used in thls study. It is that as the course was" implemented Ifl 

classes in this study, the evidence is that the younger (5th grade)*students in 

particular, and a number of MACOS students in general, were not successfully 

demonstrating ma^ery of some of the basic conc^ts. ; . ' . . 

• The implication is that if MACOS is to be- taUght^to -upper elementary 

students-, es^6cialiy at the 5th grade level, and If under standing 'of some of the' 

basic concepts >s measured by instruments such as that used here'{and a? appear. 

in the.MACOS booklet, 'Evaluation Strategies) , particular attention needs to be . - 

paid by teachers to lessons and methods designed "to teach those concepts. , 

53. E. g. , "Ohe important conceptual area where the course fails t^produce " 
signific*arit learning is that of symbolic language as a distinctly human 
phenomenon, and all other evidence points to this failure. " Hanley, 

* . Op.' citt , 'p. ni-55. , .'- . . 
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In this.r^ard, it is interesting to bote that a recent study by Fitch, et.aU, . 
'has called Into question the adequacy of trairling provided to MACOS teachers. ^4 
That study found that teachers who had received the equivalent of a basic course in ^ 

- - 1^ ■ 

Anthropolpgy (60 hours) plus 20 hours of training "consistent with normal MACOS-EDC 
recommended teaching procedures** used anthropological terms or concepts in 
teaching MACOS more accurately than did teachers who had only the MACOS train- 
ing. 55 ^The sameapplied to the students of the teachers in those training groups. 
Similarly, the students of teachers who had the anthropology course ti>aining as^ 
welfas the MACOS training did better on the MACOS achievement tests (used by the 
developers) than did students whose teachers had only the MACOS training. There 
were other findings, but the^.implication drawn by the regparchers were that: "con- 
sidering all results together, it appears that accurate-use of the terminology of the 
field, by the teacher is a crucial factor for student improvement. Apparently exposure 

to MACOS material alone i^ not sufficient to acquaint teachers adequately with the 

/ 

eg ^ ' / 

language of anthropology. . 

* ^ \ * 

Teachers in the present study were noftested (or observed) for knowledge 

or accuracy of use of anthropological or other dii^ciplinary terms or concepts. Thus, 

tio comment can be made supporting or not supporting the results of Fitch, et. ah 

■ \ ' . ■ " • ' ■ ' 

tHc item analyses presented and discussed above do, however, point to problems 
in effective learning in some areas, as measured by the AP questions. Whether the 



'54 . Fitch, Robert M.^ Haefner, John H. , and Gonzalez, Nancie, Different 
teacher training and the teaching of '^Mnn: A Course of Study. ", Social 
Education, Vol. 41, No. 3, March, 1977, pgs. 242-246, 

55 / Ibid. , p. 242. 

-56 • Ibid. , p. 246. 



problems lie in teacher.preparation, how much or in what way the course was 
imnlemented, the age appropriateness of the course, the means of measuring 
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achievement, or other. factors crcombinations of factors cannot be determined 
from the analyses presentedjie're. • - 
,4) Other Item Analyses 

a. What Would, You Think (WA and B) ' 

The questionnaire ^Tiiat Would You Think was designed to assess atti- 

■ * ■ / ■ ' ' 

tudes toward behaviors, beliefs or;3Ustoms, and towards peoples or groups that 



might do or have them. It has been seen earlier that WA and B have shown ' 

' ' I ' ' _ 

indications (though i^ot consistently) of differentiating betweeii groups on posttest 

and on Follow-up 2i though not on pretest. The scoring of the instrument was based 

on the rank ordering of responses from negative to positive by 5th and 6th grade 

• i 

students. / _ 

, The instrument was intended to pertain to a major goal of MACOS^^ond as 

• j ■ ' - . 

such it is of interest to examine distributions .of responses of MAC OS and non-MACOS 
students', for each question. In this case, it is particularly of interest to examine 
pre-post^ responses, as well as to consider response choices of 5th and 6th grade 

^ * . 

students, iPqrcentages of students choosing each response on posttest, as vyell as 

" . ■ • \ j ' ■ . 

the percentage and direction of change from pretest are given in Table III-32. 

' " ^ \ ! ' ■ ■ • ' \ ' ' 

Table ni-32|aIso shows for each question and response choice, the ra|ik order of 
the choice. The lower t¥erank, the more negative the statement, a*s seen by samples 
of upper elementary students. There are occasional ties, indicating that the com- 
puted scale values were sufficiently close as to make it not worth trying to distinguish 



57. SeejSedtion IIB. 

i 



III-135 

151 



between them.^^ The table also gives the unweighted average change for a response 
from pretest to posttest across the two groups and grade levels. It should be noted 
that percentages within a group may not add to 100% due to rounding. For the 
sam^' reason, amounts and directions of changes for airfbur choices ^thin a group 
may iot add to zero. The table is based on the total number of students rea^nding 
to each item on both occasions (pre and post). N's are shown for each group foV 
each question and column. , - 

Consider the first question in Table III-32. Students were asked to read 
the situation described, and then check the statement in Column A that was most 
like their reaction, and similarly for Column B choices. Thus, for students {M~5), 
•it may-be seen that on-ppsttest-18% .chos.e„theiirst iterrLinjColumn A ("sincejtjs^„ 
part of their religion, the custom is alright"). The +4 under that indicates that this 
was an Increase of 4% from the percentage of that group choosing that response on 
pretest (14% chose it then). The column indicates that the group of 5th and 6th 
grade students on whom the scaling of choices was based tended to rank that state- 
ment as the most positive (4), of the four in Column A. Looking across the four 
groups (M-5, NM-5, M-6, NM-6) for the first item, it can be seen that: !) there 
was relatively little variation among groups^ -oercentages of students picking that 
statement on posttest; 2) in all four groups there W<i^ an incirease in percentage of 
students choosing it from pretest to posttest (all directions of change are positive, 
or- increases); and 3) the unweighted average change from pretest to posttest for 



58 AS noted in Section II, each set of 4 responses was given Kvalue, based 
on a scale with a mean,of 5 and standard deviation of 2. , The r^nlc orders 
were obtained from those scale values. \ 
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Table ni-32 

Student Vs. Posttest Respooses, and Changes From Pretest 
to Questionnaire What Would You Think , By Group and Grade!/ 



Irr If you heard atiout a group of people in the Pacific Jslands who each year would, 
throw stones at one of their members until he was dead as part of a religious - 
custom, what would you think? (Choose the one best answer for you in Column A, 
and then choose.the one best for you in Column B. ) 



» 
I 

M 

CO 

-a 





9 / 


Rank order 
of choice—"^ ' 


< 


from Pretest- 




TTfifUPiorfif pH 




Column A * 

«< 


M-5 


NM-5 - 




NM-6 




1. 


Since, it is part of their religion the custom is alright. 


-4 


. 18 


16 


21 


18 










+4 


+2 > 


+5 


+4 


^ • O. f o 


2. 


That is a bad custom even if it is for religious reasons. 


2" 


34 


33 


34 


33 




• 


That is a horrible thing for any human being to do 




+2 


-4 


-2 




Oft 


3. 


X 


24' 


27 


20 


23 










-9 


-4 


-5 


-1 


' ^ -4.75 


4. 


It is one of the most unusual customs I ever heard. 


3 


. -24 


24 ' 


26 


26 










. +2 


+6 


+3 


* +5 . 


' ._ +4.00 






N= . • 


556 


551 


527 


"■485 






C olumn B 














1. 


It's hard to understand how people could do an awful 


2 V 


. 29 


. 27 


21 . 


26 






thing like that. 




-3. 


-6 


-4.' 


-2 


-3,75 


2. 


They are just people like we are, but they have different 


4 


28 


25 


32 


27 - 






customs 




+3 


• +4 


+5 


+4 


+4. 00 


3. 


That custom is wrong and th^y should be made to change it. 


1 


17 


' 21 ■ 


16 












. -3 


-4. 


. -4 


.1^ 


-4. 25 ' 


4. 


Some people have very strange customs/ compared to our • 


3 


27 


27 


31 


30 






customs. 




+3 o 


^+6 ■-. 


+2 


- +4 


+3. 75 ■ ■ 






N= • ■ 


553 


556 


524 


483 " 





1. M = MACOS, NM = Non-MACOS; 5 = Grade 5; 6 = Grade 6. 
„^9^. 2.. The higher the rank, the more positive the statement. 
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Table 111-32 Continued 



r 

M 

CO 
00 



-2. If a friend- of yoiyrff took your bike without permission, ran into a tree and bent 
the front wheel, what would you think? (Choose the one best answer for you in 
Column A , and then choose the one best for you in Column BQ 



Column A 



Rank order 



%,Stud8^ts, Posttest, and 
Change from Pretest 







of choice^/ 


M-5 


NM-5 


■ M:^, 


NM-6 


1. 


I wouldn't mind; the bike can be fixed easily. 


A 


- 9 


11 ' 


9 


9 








t2 


0 


-2 


-3 - 


2. 


I would be very angry at my friend for doing that. 


1.5 


45 


43 . 


. 46 


42 ' 








+2 


JO / " 


+2 


-1 


3., 


.That was bad luck for my friend and also for me. 


3 


12 "■ 


9 ; 


11 


13 








+3 


-1/ • • 


+l' 


+2 


4. 


I think that was stealing and should tiot have been done. 


1.5 


34 


37 


33 . 


36 








-3 


+i . 


-2 ■ 


+2 






. N= 


545 


545 


521 " 


476 



Unweighted 
Average Change 

-1.75- - . 

+ .75 ; 

+1. 25^ 



Column B 



—IvSometimes'we forget to. stop to think before we go 
ahead and do something. ^ . 
2. Some people will do'anjrthing if they think they can 
get away with it. . 
/ 3/ People usually have good reasons for doing things 
^ ~ even' if we don*f know what they afe. 
4. Some people just don't take very^gqbd care pf other 
peoples' things. 



-3 v 


•43 


/ • 

' 38 


39 


36 






+3 


/ -1 


+2 


' -2 


+ .5 


1 


20 


/ X ; 


23 


25 






-7 


-3 


+2 


-2: 25 


4 


13 


15 


16 






+3 


/ s 


-3 


-2 


+ .5 


2 ' ■' 


• 24 


/ 23 


23 


24 






+1 


/ -2' 


+4 . 


+2 . 


- +1. 25. 


N= 


534. 


536 


513 


477 



ERIC 



■mw^ACOS,' N1VF= Non-MACOS; 5 = Grade 5; 6 = Grade 6. 
2. The higher the rank, the more positive tlJie statement. 
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Table HI- 32 Continued 



3* If you heard that ti grouf? or people in South America tried to use magic to keep 
their enemies from hurting them,, what would you think? (Choose the one best 
^ " answer for you in Column X, and then choose the orie best for you in Column B. ) 



Column A 



M 
CO 
CO 



1. rd like to know more ^B'out how they do it* 

2'. It won't work because there is no magic, * 

3i Most people protecjt them.selves as best they can* 

4. That's not a very smart way to protect themselves. 

Column B ] . ' 



1. They sound like foolish people to have' such, a 
:' \ silly custom* * - ^ 
2* Those people may just be carrying on a very old custom* 

•-SV^that group must not have lip to date ideas like w*e d'o** 

4. ib'S'good th?rt different people can follow different beliefs 
a fid customs-* 



8 



Rank order 
of choice-/ 




.1. M = MACOS, NM = Non-MACOS; 5 Grade 5 ;'6 =-Grade 6. 
2. The higher the rank, the^more positive the statement* \ 



•Students, Posttest, and Change 
from Pretest • 



M-5 


NM-5 


'M-6 


NM-6 


44* 




4^ 
*±o 


41 




+4 


_1 


TO 




1 5 


l< 
xo* 


1Q 

J.O 




-4 


TX 


-4 


27 


£i t 




99 


+1 


TO 


TO 








xo 


94 


-3- 


-4 


-4 


j-i 


*547 


531^ r 


519 


•477 


15 ' 


14 V 


12 


o 


-4 


-3 


-1 


+1 


'41. 


- 37 


._ 41 


42 


+13 




+1 


+8 


11' 


14 


12 


• l"6- 


-4 


-1 


.-2 


'+1' 


34 


34 


35 


28 


-3 


-3 


■+2 


-9 


532- 


526 


515 


473 . 



-^cUnweighted^^ 
AverageXhange 

-+4.25 - 



-2.75 



+1.25 
-2.50 



-1.75 
+7. 00 • 
-1. 50. 
-3. "25 
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Tableful- 32 ContinuQj 



Column A 



4. If you heard that there was a country in which people often ate grasshoppers . , . 
and earthworms, what would you think? (Choose the one best answer for you" 
in Column A, and then choose the one best for you in Column B. ) 

% students, Posttest, and Chang 



1. 
2. 
3. 
4. 



I never thought that such things would be good to eat. 

.^. . _ : 

Yuck! It makes me/ sick just to think 6i eating them. 

That's no dif f erent/ frq^ our country where people " 
eat many things./- . ' ' " • 



C olumn B 



I guess it must not do them any harm, 

I don't liki2 people withjuchj;sixang'e_custpms._ 



They probably have good reasons for eating them. 
They sound like a<<5ackward group of people. 



Rank order' 
of choice—''^ ■ 


M-5 


' from Pretest 
NM-5 M-6 


NM-6 




.34 


• 33 




36 




'+3 


+3 


+3 " 


+1 


2.5 


.11 


11 


10 


13 




—1 


. r4 . 


■ -1 


+3 


. -1 


29 


34 


21 

* 


, 29 




.'-9 


-4 


-9 ' 


* ' -4 


4 ' • 


25 ' 


. 22 


. 31 


23 


» 


+6 


+4 ■ 


+7 ■ 


+1 


N= 

• 


544 


t 

- .530 


. 519" 


473 


3. . 


28 


31 ■; 


T 

1" 

35 


34 




-2 


• +5 . 


+2 


+5 


.1 


8 


7 


.4 


5 


t 


0 ' 


-2 


+1 


+1 


. 4 


48 


' 43 . 


48 ■ 


' 47 




' 0 


-2 


* 

-3 


,-6 


2 


15 


19 


. 14 


14 




+1 


0 


+1 


0 


-N= . 


5J52 


535 


521 


■ 479 



1. ^1*= 1VIAC0?,,NM= Non-MACOS; 5 = Grade 5; 6 = Grade 6. 

2. The higher the rank, the more positive the statement. 



. . Table III- 32 Continued * ' , - ■ 

5* If you Heard about a group brpeople in the United States who still firmly believe.^ - 

that the earth is flat, not round,* what would you think? (Choose the one best^^j^^, > ' 
answer for you in Column A and then choose the one best in Column BQ ^ t^^jf^''' ' 

— " 



Column A 



% Students, Posttest,.:an^/6^l^ahge 



1. It would.be interesting to know why they think that. 
2* It is'hard to understa id^why they would believe that* 
3* Those people are crazy to believe a thing like that. 
4. That is a very strange thing for anyone to believe. 



Column B 



1. There are still sbme>7ery backward peopleJn' 
our country. [ J 

2* They can go ahead and believe whatever they wqint. 

1 * 

3. There may be good reasons why. they ha/e that belief. 
4^Some people are so dumb they will believQ anything* 



Ranjc order 
of choice — 


M-5 ' 


front Pretest 
NM-5 M-6. 


't*^ Unweighted 
NM-6 Average Cliange 

• 4'8.- 


A ; ' 


'\ 48 


42 ' 


53 




+6 - 


+3- > 


■• +7 


-, -5.. ' +2.75 


3 


•22 


24 


21 


, 25". 




-3 


, t2. - 


-2 


" +4 .25 


1 ■ 


15 • 


. 18 / 


15 


15 . ' . 




/ 16 


\' +1 . 


+2 


+2 ,. +1.00 


■ 2 


16 


11 


13 * - 




V _i 


-6 


-7 


' -1 . -3.75 




527 


532 


.515 


469 



• ' 2 


14 


18. 


. : 


,12 








+3 ' 


-4 


+2 


- .25 






29 ' 


33 








• 0^ 


^_^-6 


+^-^ 


+2 


- .5. 


4 . "i 


. 43 






42 






*. +4 • 


+5 


+3 . 


-3 


+2. 25 


•1 


11 


14 


• 11 


12 






-2 


-? 


-1 


0 


-1.25 


. - ■ 


* 527 


540 


516 


470 





1. M = MACOS, NM = Non-MACOS; 5 = Grade 5; G = Gra^e 6. 

2. The higher thc'i rank, the more positive the statemeMti' 



ERIC 



161 



if 

1 ' ^ 



/ 



/ 



162 



that response was +3* 75%. The unweighted average cliange simply the algebraic 
sum ofthe four change p,er<^ent^geS for the statement, divided by 4. It should be 



rioted that the statements under Coldmn A and Column B for ezch^xe^t^oa are 11^^ 
in the order in which-they appeared on the form. 

t , With respect to question 1 '{aken as 5' whole^^t may be seen that both for 

""Column A statements a\d Column B statements the direction of change from pre- 
test to posttest for all group^ is toward the more positive (or at least less negative) 
statements. That is, if one compares the si^n of the miweighted avterage percent- 
ages of change of percent of responses ,to the •rank, orders of the statements, it can 

' be seen that staft?ments with. rank orders of 3 and 4 have a positive sign (more stu- 
dents chose those statements on posttest than on pretest). Statements with rank 

' ■ - 59^ 

oirfers of i and 2 show negative signs; fewer students chose them on posttest. 

• - _ «. ♦ 

The directions of change of responselfor all groups follow the s'ame-'patterns in 

Columns A and^-^B. On the. whole, the percentage of students' picking more positive 

statements increased from pre to posttest . ^ 

The resultant percentages of students in the four, groups shown in the 

table for question 1 are gjenerally very similar for each response ch9ice.\ There 

^are not obvious group or grade differences. Both groupr Showed small changes 

toward more positive choices on posttest for both parts of the question.; It should 



59. Statistical tests of differences of percentages (posttest or changes) were 

not ui.-'ertaken.. It is believed that the data should be examined impress ionJs- 
tically without attempting to make strong inferences based on statistical ' ' 
lest criteria. One exception to this approach may be noted. With one . . 
exception, all posttest distributions of responses.for each question and 
column differ significantly frbm.a chance distribution. The exception is 
the distribution for non-MAQOS 5th graders for Questiqa 1, Column B. ' ^ 
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not, of course, be Inferred that all |tudents who changed their choices did so 
In .a positive direction. The figures presented.here were obtained from cross- 
tabulations of responses of pretest vs. posttest for. each group. Those cross- 
tabulations show changes in both directions as well as many students who did not 
change their responses at all. Consider, for example, the 5th grade MAC 03 
students' responses in Column A for' question"!. Not shown in the table, but 
obtainable from the'pre-post cross-tabulation, is the fact that 35% of the students 
did not change their responses, 37% changed to a more positive response," and 28% 
changed to a more negative one. . , . . 

Question 2 poses a situation involving oneself. The pattern of response 
(and changes from pretest) in Column A is generalljj^way from the most positive 
reaction to the behavior (item 1) and toward a more negative or neutral one 
{items 2 and 3): There appear to be sliglit differences in the patterns of changes 
between MACOS and non-MAl: OS Students. IIACOS students were a little more 
likely to shift .toward choosing a personal feeling of anger (item 2) and away 
from a moral pondemnation (item 4) with respect to the behavior described. 
In Column B the net changes from pre to post are generally s'mall.as they are 
I in Column A. The overall ghift is in a positive direction (away from choosing 
the most negative response (item 2), except for the non-MACOS 6th graders. 

In question 3, the predominant reaction to the hypothetical custom on 
posttest was one\of curiosity ("I'd like to know more about how they do it") in 
Column A. In Column B the general changes were.away both from negative and 

/ 



positive endorsing reactions -'toward a more factually oriented position (lcem^2: 
"thesQ peoplj may just be carrying on a very old cus^'om"). ; 



'/ ■ - 

CJue'stion 4, having to do with eating unusual food, has patterns ^pf- 

changes that may possibly reflect an effect of MACOS in that MACOS'Sth and 

eth.grade graups overall show the largest net changes of choices from pre to 

posttest.. Inicolumn A, all four groups' show a tendency to shift 

away from an initial reaction expressing personal dis'tate (Item 3) toward 



reactions ot 
pronounced 



ler students had rated as/ more positi\j.§. The n^t shi-fts are more 
in the two MAG OS groups than in the two non-MAGOS groups. It is 



possible that -for some students, at^least, the experience of seeing the Netsiliks 
eating- unusjial foods may have diiyinished a pur^y.^personal paction somewhat. 



Jn Column B the predominant response of all fbi^||^:6ups is^the most poMtive 
one (item 3: -they probably have^good reason^fqr eating them"). In terms of 



reaction a 
any harm")|. 



lowever, the shift generally is away from that 
d toward a more neiltral one (item 1: "I guess ;it must not do them 



average peircentage of change. 



/ 



In 



question 5 the-preddminant posttest reactiopl of all groups for 



Column A i^esponses is the most\pos|tive <)ne (item 1: J' it would be interesting 



to know wh| they think that"). tL same is also true for Column B responses. 



Ov'erall for most question^ the percentages of students in all four 
groups choiing particular responses are similar. The net changes "from pretest 
to posttest in mobt cases are in a po^^tive direction'. In a few cases. they are toward 

a more neutlal position. Comment hak been made about the changes in percentages.^ 

1 ■ ■ \ '< 

It must be re^sognized, however, that such indicesjsan only be viewed as suggestive. 

\ J 



They are, due, at least in part, to changes of opinions of students. In all cases, however 

Tyjire net changes. As noted earlier, the actual changes of responses by 
♦ indiyiduals within a group is not reflected in the net changes. Of interest here 
are overall patterns and relationships, not absolute values. 

b. Study Choices - 
, The variable SS Ch (Social Studies Choices) has been used as an outcome 
measure in analyses described earlier in this Section. That ipeasure was the 
average for each class of the number of times social studies was chosen as pre- 
ferred when it was^ paired with five other subjects: 1) arithmetic; 2) science; 
3) reading; 4) spelling; and 5) English. The instrument from which the measure 
was derived used the method of pair comparisons, in which each subject. Including 
social studies, was paired with each other su*bject once (for a total of 15 pairs). " 
The students were asked, for bach pair, to pick the subject they would prefer if 
they had to make a choice. It is of interest to examine briefly^how social studies • 
compared in proportion of choices in relation to the other five subjects. 

Scale values for each subject were determined using the method 
-based on the assumption of a composite stanaard.^^ For purposes of comparability, 
normalized linear transformations of mean proportions for each group were con- 
verted to a scale with a mean of 5 and a standard deviation of 2. This was done 
because eight sets of scales were waated: P.IACOS *iad non-MACOS 5th and 6th 

graders at pretest and posftest. The effect of the 

60. Nx N-1/2 = 15, where N = No. of objects. 

> 

61. Guilford, J. P. Psychometric Methods (Second -Edition) New York: 
McGraw Hi'l, 195'4. See especially pages 168-177- 

rii-145 ■ . ' 
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scaling was not to make &e_ valid and absolute scale values for each group, 

i . ■ ■ . " ' 

bui to apr/ead proportions of choices on the same metric so that comparisons 

could be made. CW^er groups (and comparative evaluation models) could pro- 

duce other values. The interest here is in the students in this study. 

! Table in-33 gives the scaled values of each of the. six subjects for 

5tli graders, pretest'and posttest,. and foE 6th gr^ers, pretest and posttest, 

byigroup. The subjects are listed in theJableJropy^argMiJp_small^ 

scale value for all groups. Thus, arithmetic is listed first, reading second, etc. ' 

I ■-, ■ . - M 

. i Each distribution of scale values is read down a column. Wiat is 
* h . . . - . , ' • 

clear in Table in-33 is that, when paired with the rest of the field of choices, 

soiial studies ranked next to last in preference, (except with MACOS 6th graders - 

at posttest) and English (language arts)Tast: What is tiot.clear from the table is 

the consequence of the method. Many stuaents may love English or social studies. 

Forced to choose between them and otiier. subjects, as they were, they were some- 

whk more inclined to choose'other subjects ("I really like sirloin, but if r have 

I ■ ■ ■ . ' -- ' . ; 

to choose between sirloin and filet mignon, I'll take filet mignon")* In efiJdt, the 

method of pair coniparisons forces winners and losers. The scaling procedure also 

i ' . ■ ' ■ 

distributes the proportions of choices (which.are completely correlated with scale 

i . _ , ■ 

valkes) over a wider range than the absolute proportions, with the same parameters. 

1 Given these conditions, it is clear that: ' 1) most subjects retain thfeir _ 

rank order of preference when compared by. students to the range of choices; 2)' there 

■» 

ari generally small differences in order of preferences between groups and grade 
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Subject 
Arithmetic 
Reading 
Science 
Spelling 
Social Studies 
English - 



■ Table ra-34 
Scaled Pair Comparison Choices of Subjects, 
by Group, Grade and Time.of Testing* 



MACOS 



Grafie.5 



Grade 6 



Pre 
6.5 
6/6 
<j6, 3 
5.5 
4.2 
.9 



Post 
7.3 
6.3 
5.9 
5.3 
4.2 
1.1 



,Pre ~ 
7.2 
6.8 
5.2 
5.2 

■4.7 
1.0 



Post 
6.8 
6.5 
5.0 
5.3 
5.7 

. .8 



Noii^MACOS 



Grade 5 



Pre 
^"6.8 
7.1 
5.2 
^.3 
3.0 
1.7 



Post 

6.9 

7.4 

5.7 

4.9 

3.7 

1.5 



Grade 6 



Pre 

7.2 

6.2. 

6.2 

5.9 

2.4 

2.0 



Post 
7.8 
6.1 
5.4 
5.9 
2.9 

^1.9 



*N's; MACOS Gr, 5: 578, Gr. 6: 535; Non-MACOS Gr. 5: 572, Gr. 6: 502 
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levels xn standard deviation terms; 3) most subjects retain their position 
relative to other subjects from grade level differeoces although science and 

* CO 

spelling show'a tendency to shift from pre to post, ^"^^ . ^ 

Dn6 is tempted to speculate about changes^ Given the inethod, and- 
understanding that the data in Table III-33 are based on the same 5th or 6th 
grade students from pretest to posttest, it is clear that, within the limits of 
accuracy (and assumptions) of scaling anc^ rounding, for every gain there must 
be an equal loss* In fact, the algebraic sum of gains and losses from pretest to 
posttest, within rounding limits, is zero (as it must be, since each scale has a 
mean of 5). 

While social studies usually ranked below other subjects than English 
both pre and post, it ranked relatively higher, even on pretest, for MAC OS com- 
pared to non-MACOS students. This may have been due at least in part to the 
fact that MAC OS had been started by'students at time of pre-tesf and the choices " 
reflected^ an early interest. IVIACOS 6th grade students showed a further increase 
in choice.of social studies at pofettest; MACOS 5th graders did not. Non-MACOS . 
students showed some. increase in choice of social studies at posttest at both grad? 

. levels. The shift of social studies upwards for MACOS 6th graders at posttest is 

* # • 

large, relative-to most other changes in Table in-33, suggesting a continuing impact 

of MACOS. Ifc is not as large,- however, as the downward shift in spelling" seen for ' 

noa-MACOS 5th graders. 

A related series of questions was asked in Follow-up 2. StudeMs were asked 

62^ The order of absolute proportions of choices is the same for each group, 
grade level and test period. All that the vario.us linear transformations 
have done is to convert those proportions to scales with similar means and 
variances; they have not changed the order of a bsolute choices* 

' ■ . ' m-148 
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to rate how much they like social studies fier se on a 4rpoint scale, ranging from 1, 
Uialike '?ery much, to 4, like very much.'" They rated arithmetic, science and 
English separately on the same scale. Students were also asked: 

"Of all the topics you have learned OT studied about in school, • 
whether in social studies or any other subject, which one^ould 
you really like to know more about, if you had the chance? ^ 
.Please describe it briefly. " . ^ ... 1 

• / . A content analysis of responses was made, classifying responses asj, - " . ^ 
falling into the area of social studies vss all other. The point biserial corre- 
lation between ratings of social studies and number of social studies subjects 
(one per student) was then computed. The point biserial correlati9ns>etween - , 
ratings of liking social studies in Follow-up 2 and .statements of subjects students ^ 
would like to know, more about (classified as social studies vs. all other) were: 
MACOS, rpbi = .20; non-lVIACOS rp^i = . 24. . 

The means and standard deviations and N's, of ratings, and percentages 
of social studies statements were: ^ . ; - 

Ratings • Statements 

M ' SD ■ N. % Social Studies Statements 

MACOS ■' 3.T8 .829 508 37% 

Nqn-MACOS 3.24 .943 445 • - 38% 

With this absolute form of measure of liking of social studies, made in 

Follow-up 2 a year after MACOS, students in both groups rated social studies posi- 

■ ■\\ •• ' - " - 

tively on the average. 

The results, taken together, suggest that: 

.when students wgre asked to chocoe among pairs of subjects during the 
year MACOS was studied, social studies ranked low in preference 
on the average, for students in both groups, both pre and post; 

63. English or language arts was yet worse off; it consistently ranked last for all groups 
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• tl^e exception was for 6th grade MAC OS students in which there was 

. .an increase in rank of social studies preference from.Sth (next to last) 
at pretext to 3rd at posttest; the- results suggest a niore positive 
impact of MAC OS on the 6th graders, cqmpared to the'MAOOS 5th 

• graders; 

• non-MAGOS studerfta at both grade levels showed a relative Increase 
in preference for social studies from pretest to posttest, although 
vAe rank of that subject did not change) 

0 

& 

• students from both groups on the average rated liking of social 
studies positively^to a.similar e>rtent on an absolute basis a year 
later in Follow-up 2.^^ - . 

cr Skills and Knowledge ' . 

Two ^ the measures used as outcome variables have been the average 



of the.summated ratings of eight questions aboust skills,^ and of seven questions 
about knowledge, asked of students in Follow-up 1. The specific questions asked 



were as follows: 



"A* We'd like to know what you studied in social studies las.t year, 
and if it's giving you an advantage in social studies this year. ... 
Did you learn how to make or use maps in social studies ? If you 
did noU circle NO. If you did learn to make or use maps last year, 
how much has it helped you this year? Circle 1 if it is a grea,*^ 
advantage; 2 if it is sonie advantage; and 3 i^it is of-little or no 
advantage. 

"B. Now look at those items where you circle NO, you didn't study 
or do that last yei^r. Are there some of those things you wish you 
- had studied or done in soci^al studies glass last year because it 
would help you in social studies class this year? Put an X.in the 
circle for those things!" - 

The instructions in Part A were read aloud first: then each item was 

read aloud. Then part B was read to students.' Table III-34 shows the percentages 

' , — . . « 



64. Absolute and relative ratin|s obviously can give quite different information. 
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of responses for each item for 5th and 6th grade MAC OS and noa-MACX)S 
students. It also gives the mean for each item ba'sed on a scale of 1 (great 
advantage) to 5 (didn't and wish I had).- The last value was assigned to items 

that students circled NO and then put an X in the circle. The scale value 4 

' • \ ■ 

(didn't do or study) was assigned to items students circled NO but did not then 
put in an X. The table lists the t tills items first, then the knowledge items. 

It may be seen that many of the distributions are bi-modal, but some are not» 

> 

Considering only the means for items, the table clarifies why there were in- , 
"dications in earlier analyses of differences between groups for Skills and Know • 
WTiile differences are not large, there are cons istent.relatlonshipl between 
MACOS and non-MACOS means at each grade level for skills items 1, 2, 3, 
3nd 4. For each of those items MACOS means are slightly higher than the" non- 
MACOS means at the same grade Jevel. , Item 6 s^ows the reverse situation, 
although differences are^very smaiJ. The remaining three skills items show 
mixed relationships. The four items on which MACOS students were slightly 
more likely to express a less positive opinion, as the scale Is set up, are: 
1) how to make oi use maps; 2) how to make or use graphs; 3) how to find infor- 

mation in the library; and 4) how to write reports. The item for which non-^ 
% 

' MACOS students were &n the average a little less positive than MACOS students 
is: how to support your ideas or opinions with evidence or facts. Of all items, 
it is the item concerned with map skills that shows the greatest difference between 
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: Table III-34 , 

Were Different Skills or "Knowledge Studied Last Year 
/and What Advantage Has That §een? Percentages of Responses 
and Means, by Group and Grade Level 
-• 3' 



<5 • 

Skill Items 


Group 
and Grade 


« 

1 

* Great • 
'-Advantage^ 


• ' 2 • 
•■ Some 
Advantage 


Little , 
■ of no • 
Advantage 


--4 
Didn't do 
or Study 


^ *5 
Didn't-and 
Wish I Had 


Mean 


" N 


1, How to make or use maps 


M-5 
NM-5- 
M-6 
NM-6 


.14. 0 
19.^ . 

\ 14',-6 
18.9 


.29.0 
36.5 
37.3 
45.1 ■ 


15.1 * 
26.3 
■ 11.4 
21.3 


17.9 . 

8.;3 

16.6 
5.» 


23.1 

9.0 . 
20.1- 

9.4 


3.J 
2.5 
2.9 
• 2.4 


■ 351. 
312 
^308° 
"244 


2* .How to make or use 
graphs r . 


- M-5 

- NM-5 
M-6 
NM-6 


7.5* 
. 8.0 
7.5' 
13.2 • 


18.2 
19.2 . 
26. 0 
23.0 


16.7 
24.0 • 
13.3 
21.5 


32.3 
29.2 
« 36.4 
21.4 


25.4 
19'6 
. 16.9 
17.3 


3.5 

3.3.' 
3.1 


347 
312 
308 
" 243 


3. How to find information 
in library 


M-5 ' 
NM-5 
M-6 

• NM-e" 


24.1 * 
29.1 
23. 6 
29.4 


29.6 
28.2 
30. 5 
33.1 


11.2 
12.6 
' 12. 5 . 
8.6 


- 27.6 
^.0 
.. ' 21.6 • 
21.6 


7.5 
9.1 
11.8 
7.3 


.2.7. 
2.f 
2.7 
2.5 


348 • 

309- 

305 

245 ■ 


4. How to write reports 


M-5 
NM-5 
M-6 
NM-6 


28.2 

29^0 • . 
24. 0 
31.3 


31.0 
3^.4 
37. 7 
34.1 


10.6 

. , 11.7 
15.0 

14.2 


21.0 
13.7 
<•■ 15.0 
12.2 


9.2 
7.5 , 
8.3 
8'.1 


2.5 
. 2. .3 
3.5 
2.3 


348 
307 
300 
246 


5. How to tell the difference 
between facts, and opinions 


M-5 
. NM-5 
M-6 
NM-6 


14.1 , 
17.7 
18.? 
15. t 


•35.8 
31.5 
41.3 
37.6 


13.2 
■13.8 
' '11.6 
11.8 


24.0 
23.6 
19.8 • 
• 23.3 


12^9 

■ 13.4 
9.2 
12.2 


- - i. 9 

' 2.8 
2.6 
2.8 


34^1 
305 
303 - . 
245 ■ 


1/ M = MAC^OS, NM = Non-MACOS; 5 = 


Grade 5, 6 = 


Grade 6. 
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3 

KJ 














. 1 


9 


Little 


A 

4 


5 










- / CiTpnt 

1 / VJi 


Some 


or no 


Didn'f do 


Didn't and 






Skill Items 


and Grade 


Advanfacre 


Advantage 


Advantage 


or Studv 


Wish I Had 


Mean 


N 


fi Wow fn QiinrtivH — urmT^rlpj?^ — 


— M=-5 


13. 8 


32.6 


10.4 


32.0 


11. 2 


2.9 


347 


or opinions wicn cviucnuc 


IN XVl""*? 


Ifi 7 


30 5 


10. 5 


23. 3 


19*10 


3.0 


305 


luCCS ^ 


ivi—o 


17 4 




11 1 

XX. X 


' 25. 2 


9. 2 


2.7 


305 






17. 2 


. 33.6 


10. 2 


27.0 


^ 11;9 


2.8 


244 




^ M-5 


34. 5 


43.0 


16.5 


4.6 


f 1.4 

f 


2.0 


351 


af11Hpnf€^ in'QiYiJ^ll 'crTfiiinQ 


NM-5 


32.6 


40.7 


17.6 


7,2 


2.0 


2.0 


" 307 


0 


iVi—D 


ox. vf 


47 Q 


14 9 


4 6. 


1.7 


2^ 0 


303 


V 


NM-6 


23.6 


58.6 


26.0 


9.8 j 


. 2.0 


2*3 


246 


o* now CO looK ah all Slues 


iVl—O 




4^ 0 


117 

XX . 1 


19 7 ~ 

X«/<« 1 


12.3 


2. 7 


351 




. NM-5 

* 11 1*1 V 


28. 2 


34.0 


11.3 


15.9 


10.7 


2.5 


309 


ujqpoiuing wiidu you uiiiiiiv* 


iVl"^U 


18 6 


40. 2 


14.7 


19. 6 


6.9 


2.6 


3,06 




iNlVl— V) 


91 ft ^ 




1*^ fi 


90 9 J 


8 2 


2. 6 


243 


r^nowieoge items 










f 




i - 




i« now people unu iiusir 




9fi 0 - 




17 7 

X 1 . 1 


14.0 ^ 


5.. 4 


2.4 


350 


environment uiiect 


JNiV^— O 


. f 


*19 ft 


17 5 * 

X 1 • 


16 ^\ 


9 1 

«/. X 


2. 6 


308 


cacn otner 


l\l—l) 


9ft 5 


44 *^ 


14 ft 

X*X. O™-'— 


8 9'l 


3. 6 


2. 2 


305 


> 


NM-6 

11 1'l Vi 


21 8 


39.9 


16.9 


14. '8* 


6.6 - 


2.4 


243 




M-5 

IVl %J 


15. 8 


28.4 


11.7 


23. 8 


20.3 


3,1 


349 


customs oi oui uountrj^^ 


iiiVl—O 


94 5 


49 ^ 


11 Q 

X X . 


11 0' 

XX. vr 


10. 3 


2; 4 


310 




M-6 


10. 2 


32. 5 


16.7 


25.9 


14.8 


3iO 


305 




NM-6 


15.2 


' sols 


16. a 


18.9 


10.2 


2j7 


244 


3. The history and/or 


M-5 ^ 


* 19.0 


32.4 


. 21.9 


16.9 


9.9 


2.;7 


343 


customs of other countries 


;^M-5 


. 23.9 


44.2 


17.7, 


7.7 


6.5 


2.13 


310 


i 


'MtG 


16.9 ' 


34.9 


19.2 


15.0 


14.0 


2.7 


307 




'NM-6 


^ 33.6 


35.7 


22.1 


5.7 


2.9 


2.1 


244 



li M = MAC OS, NM = Non-MACpS; 5 = Grade 5, 6 = Grade 6'! 
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Table ni-34 Continued 



' ' ' " 1 ■ %: ' Little ^ 4 • 5 , 

I Group ^1 Great Some ' or no Didn't do Didn't and v^f * 

Knowledge Items ' and Grade*^ Advantage Advantage Advantage or Study Wish I Had Mean N 



4. 


Different beliefs 




M-5 


18.4. 


37. G 


1 25.1 


^ 14.3 


5.2 


2. 5 


■343 ,/ 




people have 




NM-=-5 


23.3 ' 


35. 1 , 


' 20.0 


12.5 


9.2 


" 2.5 


.305 ■ "[ 




■ • 1 




M-6 


16.8 


42. 6 


• 21.8 


12.9 


5.9 ^ 


2:5 


303 - 








NM-6 


18.9 


42.6 


22.1 


11.5 


5.9 


2. 4 


244 


5. 


How different animals 


M-5 


- 25.9 : 


■ -32. d 


30.8 


7.6 


3.8 


2.-3 


344 




behave and wHy they. 


NM-5 


6.5 


15.5 


.^7.1 


37. '9 ■ 


33". 0 


r' 3.8 


309 




behave the way they^do 


M-6 


23.4 


31.8 


36.7 


4.9 


- 3.2 - 


2.3 


308 








NM-6 


4.1 


13.2 


9.1 


' 55.1 


18.5 ^ 


3.7 


243- 


6. 


Similarities, and - 




M-5 


21.1^ 


35.5 


27.2 


11.0 




■ 2.4 


" 346 




differences in ways 




NM-5 


9.0 


'25.7 


11.3 


27.7 ■ 


26.4 


3.4 


311^ --' 




animals and people 




M^6 


17.3 


36.9 


35.3 ^ 


6.5 


3.9 . 


2.4 


306^ 




behave. 




NM-6 


5.3 


23.4 


16.8 


43.0 


11.5 


3.3 


' 2M ' 


7. 


Learning and under- 




M-5 


17.7 


33.3 


16.5 


20.9 


.11.6 


2.8 


,345 ' 




standing more about 




NM-5 


23.6 


33.7 


14.6 


17.5 


10. 7 


2.6 


309 




myself and people around 


M-6 


21.2 


29.8 


14.6 • 


22.2 


12.3 


2. 8 


302 




me.- 




' NM-6 


22. 2 


38.7 


8.6 


22.6 


7. 8' 


2.6 


243 



1. M= MAC OS, NM = Non-MACOS; 5 = Grade 5, 6 = Grade- 6. 
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groups*^^ There is some evidence corftent validity^ In Section V it will 

be seen that non-MACOS teachers were more likely ttean MACOS teachers 

to emphasize map and globe skills* . . > ^ 

Looking at the Knowledge or content items, it may be seen that there^ 

are three items (1, 5, and 6) for which the responses of non-MAC OS students on 

the average were less positive than those of MACOS students. ^ There^are 3 ^ 

items 'for which the opposite is the case (2; 3, and ?)• Item 4 (different beliefs 

people have) shows virtually identical average ratings for all groups. The 

differences in other items appear related to^urriculura content. Somewhat . 

more MACOS students, proportionately, at both gradelievels, iiidicated^they 

had not studie<l the historj^ and/ or customs of our country (item 2) or, of other 

countries (item 3) and felt it would have been advantageous to them in their 

present social studies to have done so. Somewhat more non-MAC OS students, 

proportionately, thaji MACOS students indicated the same with respect to the 

items dealing with animal behavior and similarities and differences of animal 

behavior and human behavior (items 5 and 6). MACOS ^tudents gave slightly 
* 

,^more positive ratings than non-MACOS students at the same grade levels for 

# • 

item 1: how people and their environment affect each other, Non-MACOS stu- 
dents gave slightly more positive responses than MACOS students at the same 
grade level to item 7: learning and understanding more about myself and people 
around me. * ' ' . ' 



65. It will be recalled tfiat in earlier analyses, class means were Used as 
the unit of analysis. Here, as with other item analyses", the^Jndividual 
student is the "unit. It Is possible in the item analyses for students from 
a small number of larger classes to impact upon the distributions and 

' * ' . means more than would have been the case with unweighted class, means. 
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.1 7-s 



4 



2-3 



, Nearly all mfeans shown in Table IIf-34 fall in the range of scale values 
*did study or learn how to do this and have found it some to little or no 



advantage this year,/ The question did not ask students to indicate reasons why 



they responded as they did. The last two categories (4 and 5) have been treated as 
if tl ey were continuation of a scale such as that defining the first three cate- 
gori es, although they are not psychometrically so, as the distributions make clear. 
There is an ambiguity in the last two categories ''Didn'tdo or study*' and "didn't and 
wisli I^had" .could mean: 1) this was not covered in social studies last year, or 



2) it 



66 



was and I did not learn it for^whateyer reason. Despite these and other 



limitations of the metho^,, there do appear on the average to be some trends 
that! seem related to the MAC OS curriculum, as -has been noted. 

" f . Attitudes of students during the year after taking.MACOS 

to 

" » *- 

An important purpose of follow-ups with students from each of the classes 

4 

in thb study was to determine how students viewed their previous year's sdcial ' 
Studies course in retrospect. Follow-up 1, in October, 1975, focused on attitudes 
toward or perceptions of the previous year's course. It also sought to survey ^ 
students' opinions of certain potentially emotionally charged topics or subjects 
student^ may have studied or learned about'^in their previous social studies course. 
In particular with MAQOS students, .there were questions ah^^ut reactiojis to such 

things a^^seal and caribou klllip^, treatment of elderly NetsiKks,c treatment of 

\ \ . ' « . , ' - " 

Netsilik;c1iLldren, hunger, sexual cu^oms, foods eaten /fish eyes, r^aw liver), etc. 
"In interviews conducted with -students at the end of the prfor school year. May 1976 
(during posttesting), MACO^ and non-MACOS students students had been asked if 
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66. Responses to all such items also may be influenced by response sets, 
halo effects, social approval sets and other extraneous factors. 

111-156^ 
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they had studied or learned about customs or beliefs they feFWere strange 
or wrong. Those interviews (reported and discussed in.Section V of this report 
revealed a number of topics (in MAC OS and non-MACOS classes) about which ' 
stoma students expressed negative opinions. Inquiry about students' opinions on ' 
a number of such topics was pursued both in Follow-up 1 (October, 1975) and 
Pollowrup 2 (May, 1976, a year aftet students had taken MACOS). . This inquiry 
was not intendei as a clinical or psychological assessment, but as a survey of 
continuing^ op in ions. <= ~ 

Some of the data collected in Fahow-up 1 and 2 were used as measures 
of outcomes in analyses reporte^J above. In those analyses, class averages were 
used as the utiit of analysis.^"^ In the opinion results to be reported here, the 
unit of analysis is the individual. student. This is done in part because the form 
iti which some of the questions were^ asked did not lend itSelf to formiag averages . 
for a^class, and in. part because it thought that the results qould justifiably be,., 
viewed as a survey of individuals, even though the individuals came from clusters ^ . 
(classej) the previous year that could make opinions jof such sub-groups correlated. 

1)' Follow-up 1 Opinions .About Emotional Topics \ " / 

' ' *. . ■ ' 

What were students' opinions in retrospect of a number of potentially 

/ 

emotionar'or value-oriented iopics? The following topics were listed in th^/ijuestidn- 



» - \ 
\ . • ■ 68 

naif fi us'ed in Follow-up 1: - c v. 



67, In both follow-ups, the class was a 50% random sample from each MAC OS 

and non-MACOS class of students who had been in the class all year ^ ■ 

(1975-76)v The same students in Follbw-up 1 were sought for Follow-up 2." 
Sample size • were maintained by fcplacement on a random basis. -Approxi- 
<^ mately 80% of the students in Follow-up 1 were alsp in Follow-up 2. 

68. The topics listed were the result of a design conference 'with consultants in whic.b 
the question of vvhat subjects nr'topics to include was discussed at length. ^ 

■ " ' » . 111-157 



.Cannibalism ^ - 

.Different beliefs people have abdut what is right and wrong 

.Killing animals J?- 

.Killing people 

. Love -> ' • 

.Hatred 

. Foods that different people eat 
^. Leaving people to die" 
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.Differrnt religious beliefs 
. Different sexual customs 
. Slavery 

, Sharing and cooperation ' .... 

Starvation 

. Trhxitnient of young p'eople 
\ Treatrhent of old people 
' Many of the tp^cs^were stated in a form that was not specific to.a 
particular course in ord§r\o make it poss-ble for students to respond in terms 
of the content of their particuli^ social studies course. Students were asked the 

V go 

followi^ng questions about each topl-^ ' 

.•'There nre people who\are coP'^erned about some pf the things 5th 
and 6th grade kids may^tudy .a school. ^ Last year in social studies' 
.did you study or learn about any of the following things? If you'did 
please put a check mark in Column Number 1 just beside tjie ones « 
you did study in social studies last year^*.' 



69. The questionnaires in- Follow-up' 1 -and Follow-up 2 were read ^i]oud . 

- ^ to.students to rpmimize reading problems. Tbe only exception was that 
instruments contained in the Follow-up 2 questionnaire that had been 
part of the pre-post, battery were administered as they hod been on 
those occasions. Instructions werq read aloud; itenjs were not. -In 
Follow-up 1, students were interviewed as a group after the questionnaire* 

.ni-158 ' . • • 



.ttWere there any of Uose things you checked in Column Number 1 
that really bothered or upset you? If there are any that bothered 
or upset you, and you wish yo^ hr^dn^t studied or seen or read 
about them last year, then put a check mark in Column Number 2 
next to those topics you wisH^oUvhadn't studied." 



« /^Even if you personally did nol study these topics in social 
, ^; studies last year, are thpre^any of them that you think 5th or 

6th grade kids should not study Vn social, studies? Check them ^ 
off in Column Number 3." \ 

These questions were formulated as a means of ^investigating concerns 

expressed by various groups and individuals (see brief review, in Section I ) about 

MACOS, and also to continue to examine opinions about certain topics expressed 

by some students- in the posttest interviews, as noted above. The purpbse of fh-e 

first quest ion was to determine the relative prevalence of opinions abou^ whether 



\ 



a topic had or had not been studied or learned in last year'^ social studies cl^ss. 

■ - - ■ ^ ■ 'A 

The purpose of the second question was to obtain an indicator of the impact of a \ 

' , '* ~ « . \ 

topic on students who said they had^studie^ or leafae<3 about it. The purposes of "~ 

the third question were twofold: 1) to assess whether studying a topic influenced 

opinions of students aboijt its suitability /or students their age; and 2) to a'ssess 

whether^ for sttidents who said that they'd studied a topic, there were indications 

of emotional impact which appeared to influence further opinions aboot suitability. 

Again it should be noted f^t the inquiry was not intended to be a clinical or psycho- 

logical assessment, but a continuing survey of opinions expressed by students over 

the p^iod of the school year following the courses under study. 

The three questions were responded to one at a time. That is, students 

went through the list responding to the first question before the second question 



was admini«Vered. They wdre asked, among other things, questions about 
thes^ topics and jtheir opinions about them. Results of those interviews 
are given" in Section VB-7. ^ " , 
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was asked.. • The third question was asked only after the second had been com- 
pleted. Students were monitored carefully to assure as accurate completion 
of the q.uestions as possible with respect to the mefihanics of marking answers. 
An error in responding, for example, was to checks topic in response to the 
second question if it had not been checkfed in response to the first question^ The 
questionnaire was a,dmiaistered to groups of students and occasionally errors 
of "the kind described went undetected. Overall error rates ofthat type in 
Follow-up 1 were low for each topic, ranging from 0-4%. Error rates had an 

. » ■ , - .. ? . . 

even smalter range in Follow-up 2. • , - 

- In sam, three questions were asked: 1) did you study. or learn about 
this last year in social studies? 2)-did it bother or upset you? 3) whether you 
studied it or not, what ^s your op nion about its appropriateness for students 
._y.QU „age.? JResults were tabulated separately for former oth and 6th grade . 
students (puesent 6th, and 7th graders) in order to reveal possible age level 
differences in opinions. Table III-35 a through o, summarizes results for Follow 
up 1. The sub-tables give percentages of .students responding to each of the 
*'three questions. The percentages are^additive within ft group (across a ro^w) 
since the response of an individual student could be Classified only in one of the 
seven possible categories shown. The tablets are set up to ;)Qrmit ease of com- 
pai-is on between responses ^f MAC as and non-MACOS studf-nfs at .a given .grade 
level. It is of course possible alsO to comptire responses of 5th and 6th grade 
MACOS pr non-iMACOS students. In each table, the column labelled 'No Data^' 

' * 0 

o 

contains the percentages of students in the particular sub-group, that completed 

the question? for that topic- incorrectly, as cles.cribed atiove. .The 'No Data' ca.te- 

* . . ■ , ■ " ■ . '. ■ . 
pory thus gives the error rate for-the sub-group and topic. 

■' • . ' > , ■ . III-160 . , 



Each sub-table in fable IIT-35 contains the following Information, 
* . - " » 

expressed in terms of percentages of studefltsi for the sub-group: 

, the percentages of studeucs indicating that they had not studied 
or learned about the topic in.social studies the year before, 
and expressing no further opinion about that topic (Didn't Study, 
No Opinion); ' * ^ ' ? 

.the total percentage indicating thatl the topic had not been studied,^ 
and should not, in their opinion^ be studied by 5th or 6th grade 
. studentsJDidn't Study, Shouldn't Study) ^ ' • 

.the ^otal percentage of students mdicating they did not study or 
learn about the topic (the sum of percentages of Didn't ^fudy, 
.1 : - No opinion and Didn't Study, Shouldn't Study) ^ 

,the percentage of students indicating they did study or learn • 

. «^ about the topic .last year in social studies 'an d ex pr essing no ^ 

further opinion about it (Studied, No Opinion) ^ ^ 

. the percentage of students indicating they studied the topic 
last year and it bothered them (Studied, Bothered) 

/the percentage of sttidents indicating they studied the topib 
last^ear,' it b'othtjrcd themr and^Sth or 6th grade students 
-should not study it (Studied,^ Bothered, Shouldn't Study); 

.the total percentage of students who indicated they studied the ^ 
topic and were |)othered byat (the sum .oi percentages of Studied, 
Bothered and Studied,' Bothered, Shouldn't Study) 

■* * . /♦ , 

- . • ■ 

. the. percentage of students indicating tliey studied the topic, 
it did ftot bother them', but that in their opinion, 5th 'or 6th grade 
students should n^t study it (Studied,. I^ot«Bothered, Shouldn't ' 
* Study); • - ; . . -■ ' * 

. the total percentage of stud.ents indicating they studied a topic 
^ (the SUM of percentages of .Studied, No Opinion; Studied,- Bothered} 

Studied, Bothered, Shouldn't Study; and Studied, Not Bothered, 
■ Sho^ildn't Study)- ^ " ' 

■• . , ■ " ■ A . ' • • _ 

.the total percentage of students expressing the opinion that the topic 
' ' shouldn't be studied by 5th or 6th graderss whether the respondents 

had' studied it br not (the sum of percentages of Didn't Study, Shouldn't 
' - Study; Studied, Bothered, Shouldn't ,Study;_afld Studied, Not Bothered, 
■ . Shouldn't Study) - ' 

* ' ' III-161 ^ . 
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■ ■ . .the percentage of students completing the questions erroneously 

• (No 'Data); • . , . , 

^ ** '• 

.the approximate percentages of students in a particular categ9ry, ; 
for example, Didn't Study, \yho did or 4id not expr.ess further ' * 
opinions about the topic (e.g. , Didn't Study, No Opinions, or Didn't 
Study, Shouldn't Study divided byDidn't Study, No Opinion plus 
. Didn't Study, Shouldn't Study : „ . i . • 

' * ». ■ • 

71 

In each table percentages are rounded. If the percentage category any , 
^ell is not zero, but is lejis than .5(%),that fact is indicated by a dastf{-)- Tha! , 
condition indicates the presence of 1 respondent classified in that category. If 
the percentage is sp^.ciiically zero, it is shown as 0 (%). Percentages added for 
all seven cat^qries should total to 100%, but may not du^to rounding. 

Consider Table III-35, a , with respect to the three main questions asked. 
For MACOS 5th grade students (N==3B1), 69% plus 16%, or 85% indicat^^a they had ^ 
not studied or learned'about cannibalisni last year. Approximately 1^5% (13 plus ^ 

1 plus if) indicated they had studied or learned about it, and an additional 1% . 

• ■ ' ' ' / 

^completed the three questions incorrectly (No Data). The total is 101%, due to , 

rounding errors. Approximately 21 of the total group Indicated thgy had studied 

cannibalism and it bothered or upset them. Approximately 17% of the total-group 

indicate^ by their response that they thou^ht'the topic should not be studipd by 5th or 

6th graders.** The comparable percentages for ihe non-MACOS 5th grade (now 6th grade) 

students are: studied it, 83%, didn't study it, 17%; studied ancl bothered, 5%; ^ 

70 . The within sub-category percentages are approximate due to rounding , ^ ^ 

qnd also due to the No Data percentages. Since the No Data p'ercen- 
^ : ta^es are typically very low, the within sub-category percentages de- 
rived by this method are considered to be sufficiently accurate for ^ 
general descriptive purposes. • ^ 

71 . A . 5 or more rule was used for rounding up; less than . 5 for rounding down. 
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Table in-35 , 

Follow-up 1: Recollections of Studying Topics Last Year 
(ind Opinions About Them, by Grade a,nd Group (Percentages 
of Students)- 



/ . 



Didn't Study 



Studied / Studied not 
Bothered Bothered 



/• 







-'^ Group 


Dida^t Study 


Shoufeni't 


Studied 


Studied 


Shouldn't 


Shouldn't 


No Data 




Topic 


Grade 


No Opinion 


. Stugly ' . 


J^o Opinion 


Botheired 


Study « 


Study 


N* 


ct* \^ uUlliUd 1 io 111 




* MAC (DS 


69% 


l'6% 


13% 


1% 


■1% 




- fk 












14 

X*x 


11 


1 


1 
X 


1 
X 


A ■ 

X 


*^1 9 
0* ox^ 






MAP 


oo 


. 19 "* 


1 7 

X 1 


1 

X 


X 


1 
X 


1 


9Q0 


• 




iNOll-iViAO LO 


Do 


1 *\ 


1 7 
X i 




1 
X 


X 




94 ft* 
























h Tliffpypnf ^ 


o 


\TAPrtfI * ' 


^0 /o 


1% 

X fO 




O /O ' 


1% 
X /o 


1^ 


1% 

X /O 


OvIX 


Ucllclo pcUpiC 








1 

X 


ov / 


*x 


1 

i 


'§^ X 


1 ** 

X 


*i1 9 
ox^ 


bK^iTA oVvrviil- v^ifrVif* 
*naVc^ dUOUt rigiK 

3iia wrong « 


* a 
0 


"YT A P rV5 


91 




7 A / 

/ 




X 


X 


X 


9on 




jNOn-iVlAU Lto 




* X 


71 ^ 
u / X' 







X 


9 


94 ft 
Z40 












/ 












C. i\lULllg 


" O 




'^■^0 


c 


* 4y 


91 

^X ' 


XX 






A1 
oOX 






Mrvn TVjTAPOC 
iNOn—iVLAL/ Co 


'in 






1 n 
xo 


Q * 

O 


- 9 


A. 


*i1 9 




u 


* MAPO^ 








xo . 


{\ 
u 


O 


9 






it 


INOn-^iVl f\0 UD 


A CC 

40 


1 A 


\ *?7 


0 


4 




Q 

o • 














\ 












d. Killing People 


5- 


MAC OS J 


. 53 


21 * 


. 14 


5 


3 


1 


2 


361 . 






Non^lACOS 


49 


16 


13 


11 


5 


3 


4 


312 




6 


MAC OS 


49 


19 


19 


4 


4 


3 


2 


290 






Non-MACOS 


44 


' 19 


25 


4 


3 


3 


2 


-^ 248 




« 




-< 














3 


^e. £^ve . , ' 




MACOS ^ 


. 57 ■ 


12 


38 




1 


2 


1 


361 






Non-MACOS 


61 


7 


20 


1 


• 1 


.1 


0 


312 




6 , 


MACOS f 


58 


6 


35 


0 


0 ' - 


1 




- 290 






Noh-MACOS 


57 


; 12 


- 28 V 




■ 1 


2 


0 


248 



t 

CO 




Percentages are rounded and may not add to 100 dueto rounding. 
A dash (-)' indicates a percentage of loss than . 5C( ; a 0 indicates 
no respondents in a celU ' ^ . " 
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2. Formof grades - 5th g/jde students were 
^* presently 6th graders; Gth-grrJe students 
were presently 7th graders.^ 



ISS 
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Table III-35 Continued 



1- / 
"» / 

/ • 



Topic 



Grade 



Group 



; ' Styaied Studied riot ' / 

) , ^ Didn't Study * ^ Bothered, Bothered . ^ / 

bida*t Study; Shouldn't Studied \ Studiecl* -ShQuldn't Shouldn't* " / * 

' 1^0 Opinion Study No Opinion' Ai3otheredr ' Study Study No Dpta 



2 
1 
0 



N 



f. Hatred 



MAC-OS . 
Ndn-MACOS 
MAC OS 
Non-MACOS 



50 

46 
40 



■ 7 



36 
40 
40. 
45 



4 .■ 
6 
3 
2 



1 
3 
1 
1 



1 
2 



g. Foods ,that 
different people 
eat 



/MAC OS 
Non-MACOR 
MAC OS 
Non-MACOS 



14 
14 
17 
15 



67: 
74 
71 
82 



"si 

.9 
1 



2 
2 



1 
1 

0 



\ 



T 



h. Leav^ing' 
people to die 



MAC OS 
Non-MACOS 
MACOS. 
Non-MACOS 



29 
53 1 
29 
53 



7"^ 
14 

8 
16 



39 
17 
45 
22 



16 
7 
8 
4 



7 

9 




1 

.3 
1 
1 



i. Different j 
religious beliefs- 



MACOS 
Non-^L^COS 
MACOS 
Non-Mf\COS 



-19 
22 
11 
]5 



1 y 

3 
2 

1 



74 
•71 

96 
83 



3 
1 
1 
0 



1 
1 
0 
1 



1 

,1" 
.0 
0 



361 
'312 
290 
248 



361 
312 
290 
248" 




248 



. j. Different | 5^ 
sexual custbqis " 

6. 

\ 



MACOS 
Non-MACOS 
MACOS 
Non-I^UCOS 



43 
52 
49 
42 



19 
20 
14 
21 



32 
23 
29 
31 



1 

2 



3; 

1 

5 ' 



k. Slavery 
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5 ^ MAC OS 

Non-MACOS 

6 . . -MACOS 

'Non-MACOS 



50 
21 

50 

.23 



3 1 
2 

4 . 
3 



31 

47 
29- 

62 ■ 



10 / 
17 ^ / 



8 -i 

3 ; 
^ / 



,1 

3 
2 

4 



2 
1 
2 

1 



361 
312 
290 
248 



•361 
312 
. 290 
248 



130 



~ / 

/ 



Topic 



Grade Group 



I. Sharing and 
cooperation 



Tabll ni-35 Contmued 



Didn't Study, ' ; 

Didn't Study, Shouldn't ' Studied;, Studied, 
• "No Opinion Study No Opinion Bothered 



5 MACOS \ 
N6n-MAc6s 

6 MACOS 
Non-MAGOS 



31 
30 
31 
37 



1 
2 
1 

2 



65 

65 " 

66 

59* 



Studied Studied not 
Bothered, Bothered,* 
Shouldn't Shouldn't 

Study Study 



No Data 



1 
1 
1 
.1 



1 
1 
0 



-1 

d 

'1 



N 



361 
312 
290 
248 



• 


, m. Starvation " 


5 


MACOS 




3 


-45 


17 


3 - - 


1 


1 


* 


361 








Non-MAGOS 


' 29 


4 


y 40, ' 


". 17 


4 


5 


- 1 




312 




> 


6 


MACOS 


3S 


3 


( 47 


8 


4 


2 


f 

1 




; 290 








Non-MACC% * 


37' 


4 


,\ 49 


8 






1 




248 


1 














\ 






* 






n. Treatment of 


5 


MAC OS ^ 


48 ■ 


3 


41 


4 




2 


1 




361 . 


* cn 


young people 




Non-MACOS -f 


56 


■ 5 . 


• - " 29 - 


4 '. 


3 


1 


- ' 2 




312 




* 


6 


" MACOS ' ' ■ 


• 36 , * 


"3 


55 


■ 2 . 


1 


. 1 


1 




290 








■ Non-MACOS 


■ 52 

^ 


4 


.42 


1 ■ 


1 " 


' 1 


■ : I 




248 














* 






o 










0. ^ Treatment of ^ 


5 


MACOS 


36 


3 


47 . 


9 


3 


• 2 






361 




old people 




Non-MACOS 


44 


. 6 


- 35" 


7 


5 


2 


-1 




312 






6 


MACOS 


30 ^ 


4 




3 


3 


1 


1 




290 




- 




Non-^MACbS 


46 


2 


47" 


1 


2 


* 2 


1 




248 




s 










r 
1 












f 




« « 




* 


















>« 
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studied and not bothered, 15%; should sttldy thi& topic, 16%* 

Still ^consider the same two groups tor the topic •cannibalism / Of 
the 5th grade MACOS students who said they didnH study it, approkimately 
19% saidjt^hould not be studied (16%t69% ^ 16%, or 16T85)},81% expressed no 
Qegative opinion about suitability (6&-f 85). Of the approximately 15% of the 
students who said they studied it, abo^^% expressed the opinion that Jt should 
not be studied (l4l3 + 1+1, or if 15), while about 93% did not express that 
opinion. Of the approximately 15% of the students who said they studied it, 
alCut 13% ( 1 + 14. 15, or 2415) also said it bothered themj^ while about 87% 
did not express that opinion. The comparable approxWate percentages for 
the non-MACOS 5th, grade group are: * 

.did^i't study, shouldn't, 17%; didn't sttfdy, no adverse opinion, 83%; 

c 

V .studied, shouldn't 12%; studied, no negative opinion about suita- v 
: bility, -88%; - ] ^ \ 

.studied; bothered, 29%; studied, not bothered, 71%. ^ 

Th^ two groups of students, (MACOS and no'n-MAOOS 5th graders) were 

quite comparable, for this topic, with respect to the three main questions, afthough 

the non-MACOS 5th graders who said they had studied cannibalism were a little 

more likely to^say it had bothered them (in Pollow-ug^l) than were non-MACOS 

5th grade studehts who also said th^had studied it. Although a number of com-: 

btnedfigures have been given to illustrate the information 'n the tables, th^ basic 

relations are evident in them. There were several ways in which th a information 

could have been organized. It was felt that the form of presentation in Table III-35 

provides tjie reader with the most generally useful information, and also provides 

the basis for presenting summary descriptive statements. 
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2)- Summaries of FolIow-up-1 Opinions by Topics 
Taking the topics listed in Follow-up 1 in order-(Table-in-35a-o), 

the following are descriptive summary statements of how the fjroject viewed 
' 72 " 

the results. ^ / . • - 

.« Cannibalism , s - 

Mosf; MAC OS and non-MACOS students at both grade levels sa' 
they had not studied it. A few s|udents in all groups said they 
"had and it bothered tiiem. Non-MACOS Sth^graders who said 
i ' they had studied it were a little more likely to have said it 
bothered them than were students in other groups. 
. Different beliefs people have about what is right and wrong 
The majority of students in all f^ur groups said they had 
^ studied them. Former 5th grade students both in MAC OS 

• * ^ aiia.non-MACOS groups who said they studied them were 

slightly more likely to jndicate^being bothered than former 
6th grade students in both groups. Slightly smaller proportions 

of students in all grcuips who said they studied them felt they 

, ' ' ' » » <x 

were unsuitable as topics of study than the proportions of stu-' 

dents saying they did not study them.. With respect 6o both 

' . opinions, the proportion of students expressing negative opinyDns 

in all groups was small. This did not appear to be a potentially 

sensitive topic gauged by .students' opinions-. 

^2"! The statements are impressionistic It was decided not to test the' 

sigaificaric^ of differences for individual follow-up results (Follpw-fup 
If Follo w-up 2), but. to test the si^nific<mce of changes in responses 
^ from FU-1 to FU^2; • ' ' 
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S Killing Animals • ' " . '. 

^ The majority of all students except tion-MAGOS 6th graders 
said in Folltaw-up Lthey had studied or*learned about . tha t. Pro- 
" portionately(5(jfore 5th graders both in MAG OS and non-MACOS 
groups who said they had studied it also said it bothered them 
than did 6th graders who said they had studied it (approximately 44- 
47%, compared to approximately 26-28%)r. Proportionately more 
students in-all groups who said J;hey I^fid^stu^ied it and were bother- 
ed by it vfeT(^ likely to say that the topic should not be studied than 

- - • * 

those who said they studied it and weren't bothered, I^roportion- 
ately abojajt the same number of students both in MACOS and non- 
IV^COS 5th grade groups were likely to say the subject was inap- 
^opriate whether or not they said they had studied it, so there 
seemed to be no effect of studying,' learning or jseeing it or not* " 
That is, curriculum in this case did not seem to change opinions' 
with younger students, given only Follow-up 1 results.* With 6th 
^ grade WEAC6)S and non-MACOS students, opinions about suitability 
\Vere somewhat more apt to be rfegative if students .said they had 
not learned jfbout killing animals (24-26%)* than if they said they 
had (12-15%). This appeared to be a*subject which had strong 
potential impacts on "both groups (MACOS and non^MACOS), as*" 
gauged by Follow-up 1 responses."^ The impacts seemed greater 
on former 5t4i grade than-otnoFTner^th grade students in both groups. 

. III-168 • * . 
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'♦ Killing People ... ° . J ' 

•the majority of students in all groups in Follow-up l_sai)a 
they had i\ot studied that (63-85%). This was .a topic for which 

*.' % «■ v.. 

a proportionately greater number 6f non-MACOS than MAC OS 
5th graders ^aid it bothered them (50% vs. 35%). Both 5th grade 
groups had greater proportions of students than 6th graders 1n- 
dicating that it bothered them. ProfJortions of students in both 
groups and grade levels were similar with respect to considering 
this topic unsuitable for students their age, regardless of whether 
they said they h\d studied it or nqt. SJjidents in both groups 
at both grade levels were only.very slightly more likely to judge 
. ' the topic unsuitable if they said they had studied it and it bothered 
them,"^ 'This appears to be a topic sensitive to grade level, not to 



curriculum. 



■ . .Love 



Table III-35, e, makes it clear that most students in both groups ^ 

. ■ • . -• , ■ " / 

^'>V did not oonnect this topic v*^ith anything they recalled qtudying or 

learning about in social studies the year before. Few students in ^ 

' ' ' any group or grade level clajmed td have been bothered by it if 
they said they had -studied it, or thought it should not be studied 



r 



73. In what context might students in non-MACOS classes have learned 

about killing people? Current events (e.g. , Vietnam),^ and history - 
. (battles) came up during Follow-up 1 interviews as frequently cited 
. ''examples. . . 



^ . ^, ' • 111-16? . i 

ERIC , \ ^ 196^ ^ / . ^ 



4 



. Proportionately somewhat mcfife stud^ents thought the topic * 

uasuitable if they- said they had not studied it thanaf they said 
* • ."^ * * • • ' • ♦ 

»they Had*' This topic appfeared to be one that was of little conse- 
quence in terms of impact to students who said they had studied 
(learned about) it in some-sense inr social studies the year^^before, 
arid of slightly more^consequence to students who. said they^hadn't. 
. Hatred , . • / ^* * * 

* Sixth graders in both groups were more likely to say they ^ 

'^»* 

had studied about that than Sth graders. Further, with the* 
; exception of non-MAGOS 6tl^graders, students Wjgre a little 
nfiore lik^y to express concern (bothered) about that topic 
if they said they had studied it than was the case with ''love.'' 
It may be noted here that in administering the questionnaire, 
students frequently asked what Ij^tred nieari^IUis concluded 
that this was not a particularly sensitive topic to^students who 
thought they uftderstood it and who said they had learned some- 
thit^ abbut it, relative to students who s^d they had not stu- 
died it. Its* negative connotation seemed to provide pause for . 

» ' , • *■ 

tl^dught among a*few students.^ 

. Foods thaC different people eat 

Here, in Table IH-35; j, it is readily apparent that proportionately 

more students in both grade levels -of MAC OS students reacted a 
i ' ' ' , . 
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little more strongly to tfiis topic than non-MACOS sty^ents^at 
comparable grade levels. The fereat fnajority of all students 



recognized this as a topic they had studied or learned In social 

studies the previous ydfer, a poirjt that*lends face validity to 

t"* ' - . • , 

results. MAC OS students, in posttest and Follow-up 1 interviews, 

often mentioned the Netsiliks\ eating habits; non-MACOS sfcu- 

* 74 

denti? ^seldom raientioned foodjij a§ a topic of interest or concern. 
Proporftonately few students who said they had learned about " 
the subject thougfit"* it unsuitable^or students their age, regardless 

whether they said they were bothered by it. 'A^softfewhat 
greater percentage of students who said they had not learned 
about such things expressed the opinion that they \vould be in- \ , 
appi?opriate to study or learn. It is, concluded that in F(pllow-u^,l 
. the Netsiliks* eating habits continued to be vivid in the minds of*' . 



many MACOS'&tudents, althoi^h students did nqt, forH:he most 

' ^» 

part, go on to express the opinion that the matter was age in-' 
appropriate. » • / • ' ^ 

• - . ' ' \ - - ■ • •■• ♦ > 

> Leaving People to die \ - 

.This concept or topic ^vas .intended specifically to conttast'MACOS 
with non-MAC OS ^tudentSj and the results in Table III-35, k, v 



See Section V5B6 and 7 for further information on this subject. . 
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year before. ^Few students indicated that ^ey thought the subject 
ajge inappropriate, \yh ether they jsaid they hAd stu'died it or not. 
. Different sexual customs , * 

* 'The majority of students in MACOS and noh-MACOS icl^isses 

said they had not learned about such things. If students .in either 

^ . ^ ' ' 

main group (MACOS or non-MACOS) said they had studied about 
• such matters, J6th grade students in both groups weife slightly 
^more likely to indicatethat they thought they were age inappro- 
priate (15-16% vs, 11%). I^w students in i^ither main.group, 
regardless of grade level, said\hey were bothered By suph mat- 
ters i|i:hey sai{J they had stifdied/them. ' Sfudeftts who s^id they/ * 
'had studied them and also said they vvere not bothered were a 
little more likely to say they were unsuitable than if they said . 
. they had been bothered by them Stuc^nts who said theyltad not 
iearned about such matters were proportionately somewhat more 
likely to express the opinion that tliis. topic was grade unauitabje 
than students who said they haU studied them (roughlyr^2h33% 



vs.- 11-lQfo, respectively). . This seemed to be a topic wljich, • 
'whatever students understoojd by it: 1) differentiated between 
students who said they had and hadn't studied such. matters} no 
matter what the curriculum; and 2) evoked judgments aboiit suita- 



bility from students ^w1T5^id they had studied about it that were^ 



Again, interview data, discus^^efl in Section and 7 help clarify 
what these responses meant. \ • ' | 
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year before. ^Few students indicated that ^ey thought the subject 
ajge inappropriate, \yh ether they jsaid they hAd stu'died it or not. 
. Different sexual customs , * 

* 'The majority of students in MACOS and noh-MACOS icl^isses 

said they had not learned about such things. If students .in either 

^ . ^ ' ' 

main group (MACOS or non-MACOS) said they had studied about 
• such matters, J6th grade students in both groups weife slightly 
^more likely to indicatethat they thought they were age inappro- 
priate (15-16% vs, 11%). I^w students in i^ither main.group, 
regardless of grade level, said\hey were bothered By suph mat- 
ters i|i:hey sai{J they had stifdied/them. ' Sfudeftts who s^id they/ * 
'had studied them and also said they vvere not bothered were a 
little more likely to say they were unsuitable than if they said . 
. they had been bothered by them Stuc^nts who said theyltad not 
iearned about such matters were proportionately somewhat more 
likely to express the opinion that tliis. topic was grade unauitabje 
than students who said they haU studied them (roughlyr^2h33% 



vs.- 11-lQfo, respectively). . This seemed to be a topic wljich, • 
'whatever students understoojd by it: 1) differentiated between 
students who said they had and hadn't studied such. matters} no 
matter what the curriculum; and 2) evoked judgments aboiit suita- 



bility from students ^w1T5^id they had studied about it that were^ 



Again, interview data, discus^^efl in Section and 7 help clarify 
what these responses meant. \ • ' | 
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^ rtot dependent on.poi^stble emotional impact, 
. Slavery , • ' 
The* majority .of non-MACOg students daid in Follow-up 1 that 

* they had studied this subject in social studies last year/ ^ ^ 
The 'majority olMACO& students said they had not. If stu- 

4 • , 

dents in either group said theyhad learned about it^i^they were 

also apt to say the subject bothered them, 5th graders more so 
• « - ' , 

• thaj) Gth graders (29-33% compared to 10-21%). •proportions ; 

• ' • * >, 

of students expressing the opinion that" the subject should not 

\ be studied were similar for students who said they had or had 

' ' not studied it.;. Abbut the same proportions of students who fiaid 
" * , - ' . • ' 

they ftad learned about slavery and were bothered by:the topic 

' ^ ^ > ■ . " ' -. ' • . ■ 

said it should not be studied as students who shi^d thex studied . 

-about it and were not bothered. Overall, this aopeared to be^ 

• * ' ' ' ' • 

a topic which had an impaction some stiidents if they, said they 

- ' rememberedistudying aoout it. ^ 

'. Sharing and cooperation . « " ' * . 

7he mafjority of students in.both groups at botff gradq levels* 

said^they recalled studying about this fhe^prev^ious year. It 

_ • appeared to have litti6»?hegative impact, as might be expected. 



7 Starvation 



The majority i)f students in botti groups said they had learned 
about this in social sfudies the previous year. Of 5th grade 
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students in both groups who safd they had learned about it 
approximately 30% also sjiid it liothered them^ Among 6th 
graders who saicJ they had learned about starvation in social 
studies tfil previous vear, approximately 20% of the ^ACOS 

' — ' 

students anda4% of the non-MAGOS students also said it 
bothered them. For the most part, the proportions of stu- 
dents indicating that it was not aa age appropriate subject 

were similar rt^ardless of whether students said they had 

' /a * ' . ■ . " :.\^ ^ 

studied it or not. Also, for students who said they had stu- 

died It, there was no no obvious relationship between opinions 

about suitability^and whether or not the subject bothered ^ 

students. Overall, the subject of starvation seemed to have an 

impact on some students who said they recalled studying it, 

more so among 5th than 6th gracjers* 

. Treatment of young people /• 

• ^ * % 

Table ni-35, n, shows that except for MAC OS 6th grade students,^ 

about 50% or more of the MACOS and non-MACOS students said^ 

they remembered learning about this topic in social studies the 

jrear before. There was a slight indication that 5th gra^e students 

in both groups were more apt to be botherdd by the subject- than J 

6th grade stude|its. There was no strong indication that wbcthe/ 

> 

"di" nofstudents said they had learned 'about .it was associated ' 

X . - 

with opinions of age appropriateness of the subject. There was 
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no tndication that students both in MAC OS and noD,-MACOS 



groups were more likely to consider it unsiutable if they 

'also^aid tlieyjy^erj^^^^ 

oyeratl a topic about which students expressed negative . 

^ • opinion^ on the Follow-up 1 questionnaire. 

t 

.•V ^ ^ . 

^ > Treatment of old people 

. Approximately 50% of the nonr-MACOS students said.they had 

studied this topic last year; 60%or nfore of the MACOS students 

>n said theyihaS. It was a. subject which, if students saidvthey 

^ .had studied it, was more offfen said by 5th grade than 6th krade 

" ^ 'pi 

students to tave bothered or upset them. Proportions of students 

• « < 

expressing the opinion that it jshouid npt be studied wel-e similar 

' ^ , - 5^ ' ■ , 

for groups that said they had or had nor studied" it. THfere was 
. indication- that this subject potentially ^lad more impact on 5th^ 
' . - ^ * gta^Jers from both groups than some of the other topics listed* 
. ^ .. 3) Dpittions Expressed in Follow-up 2 " - • ^ 

» • ' ' ' ^ f ' s 

Six of the 15^>topics asked about in Follow-up 1 wereJnclu(Jed in Follow- 
up 2. * The bases for selection were: "1) they were fopics which appeared to have 
'had more potential impact on MACOS and/or non-MACOS studenta,^^ither gene- 
^niy^^^wTtlT respect to grade level; and^) niey"were EopTcs about whicR stude^fs 
were apt.to express opinions when interviewed after completing the FoIIow-up 1* 
questionnaire* Tfie topiGs'4ncIuded<n Follow-up 2 were: 



.Killihg'^himals.n 

* Leaving aeople to die* 



0 



III-176 



203 



• Foods thgt different pepF4e-eat 

* ^ ■ 

..Starvation 



• Treatment of old people 

• 4 

. Slavery - . 
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The purpose of surveying studepts' opinions ibout thpse topics which, 
many studeiits said they had studied (in some form) in social studies'4ast year 
was to determine whether attitudes about them, as gauged by^ students' responses, 
remained the same, and if not, how they changed* The same questions as in 
Follow-up 1 were asked in the same way in FoUow.-t 

Approximately 80% of the^students who wer^^n Follow-up 1 wer^ also 
in Follow-up 2* la order to assess stability a^nd change,*cross tabulation'of 
their responses in Follow-up 1 versus Follow-up 2 was made for Sicti of the 6 

C . . . • ' 

topics. ^ ^ ' - - 

How stable were students' responses over time (from Follow-up 1 to 

Follow-up 2)? There are sever^il issues* underlying that question: 

.Is there reason to believe that -students* responses have a 

* substantiaUDasis (i. e. , were proportions of consistencies and 

changes in students' responses from Follqw-iip 1 to Follow-up 
'2 other than chance occurrences)? If so, one would have more 
confidence in analyzing anrf interpreting-consistent and changed 
responses. " ' n . 

.If there were substantiaLcpnsistencies, of or changes in responses, 
what were they (i:e. with respect to what topics and what questions)? 

^ Foi^exampie^a-marked-sh/ft by the same^tudcnts fyont "ndicating — 

that the topic 'killing animals' bothered and upset them to indicating 
in Follow-up 2 that it had not would support the hypothesis that 
* (f the impact of the topic^diminished over time. 

.If th^re were substantive consistencies of or changes in responses, 
were-they the same between groups^ (MAC OS, noite^fAC OS) an^ 
between grade levels (5th grade, 6th grade)? For example, a 
differential change of opinions between MA.COS 5th graders and 
MAC OS 6th graders would suggest differential effects of time 
* (and/or intervening exfieriences) related to age differences although 

other hypotheses are also tenable. 

. . ' ni-177 • . 
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^ The fir^t issue particularly needs further elaboration. Consider the 
questionr^ "last year in social studies did you study or learn about /this topic/?'* 



'There are four possible ways in which the respcmses of the same students could 
be classified if one considers responses for the same topic in Follow-up 1 and 2: 

.YesT yes 

'.No, no^ ^ • V ' 

.Yes, no ^ % 

* ^ . No, yes . , 

The first two possibilities are consistent responses from FU-1 to FU-2. 

> *• 

The second two are changes. An indication of stability would be that the proportions 
of students giving the same response m Follow-up 2.a"s in Follow-up 1 are signi- 
ficantly different irom the proportions giving a' different response. More specififcally, 

*'an indication of stability would be rejection of the hypothesis that the chance of giving - 
consistent responses and of changing responses i^ 50%^ jGiven the sample sizes involved 

Jyere, that would mean essentially that the percentage of sfudents in a particular 
group and gra*de level who maintained the -same response from FU-l to FU-2 should 
be equal to or greater th5n approximately 60% or equal to or lesstthan approximately 
40%.^^ Those limits were applied to^an evaluation of the presumably factual question 
of whether or not a topic was studied last year in social studies,, and to the question . 



of \^hether students thought the topic was suitable or unsuitable for 5th*and 6th grade 

students. The criteria appear present a contradiction. If more thanjSO% of the 

students in a group changed responses to a question, that would appear to be a strong 

76*.. Assume a sample size of 200.' To accept the hypothesis that an obtained , ^ 
proportion is not different Xrom^. 5, Using a two-tailed test for the *05 
level, thosQ are the approximate upper and lower bounds. They are cony^ 

servative for the larger sample sizes of some of the groups. ^ 

-< . i , 
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indication of instability^ It was belfeved, however, that little could be §aid of con- 
sistency or change if the chances of both were 50/50^ , 

The question of -whether or not students continued to indicate that they 



were bothered (or not bothered) by a topic is contingent uppn whether they con- 

tinued to say they studied or learned, about the topic. The points of interest ia . 

the case of this contingent questioa are the relative distributions of responses 

• / - . • • 

between groups and/or grade levels, and the amounts and direction of changes in 

responses for different groups of students. One should be conservative in inter- " 
preting such distributions. However, substarjtial differences and shifts of option, 
given that students continued to state that they studied the topitf, are of interest. 
Shifts, proportionately more in the direction of going from bothered to not bqthered - 
could suggest a diminishii^ of impact of the topic Qv.er time. Shifts prdportionately 
more in the opposite direction would suggest an increase in impact over time, 
>V>ssibly because of further experience during the intervening time. Shifts that are 
"proportionately equally likely in either direction are^less substantively interpretable, 
although again the proportions of students giving consistent responses relative to , 
those changing theiivr^sponse from Follow-up 1 to Pollow-up 2 can provide information 
suggestive of the.possibl'e nature and^direction ot impacts. 

Table III-36 through III-41 show for each topic * how students, .by group 
and gi^ade^level:, responded tqtjach of the-thre(^questions-%ot4iHki^oll0w-up-4r4ind 



Follow-up 2. With respect to the issue ""of stability of responses to the questions of 
vyhethqr students studied it and whether they thought the topic suitable or unsuitable, their 
was only one case in which the proportions did not meet the test criteria described above. 
For the topic "treatment of old people", the non-MACOS 6th grade group was ^equally 



likely to give consistent and changed responses to the question of whether they had 
studied ft (Table III-40a), Otherwise, 'all groups met or exceeded the chance criteria 
for those two questions for each topic^ 



The tables reveal interesting results. The substantive questions of 
the nature and direction of consistent Responses and of changes, within and between 

groups and grade levels are generally clear. Cbnsider, for example. Table 

-» * ' - . 

^hich pertains to the topic 'killing animals' • A majority of. MAC OS students at ^ 
—both grade levels (67% and 61%) continued to say that they had studied that topic. 
Tea to fifteen percent of the MAGOS students continued to say they had not. By 
comparison 20-25% of the fion-MAC OS- students continued to say they had.studied 
the topic in some form last year in social.studies^ When MACOS students changed 
their responses about studying the topic, it was proportionately more in the dire^tioa - 
of going from not studied to studied than vice versa. In effect, the proportionate 
direction of cha^ngeir? response to the (question in Follow-up 2 was from 'no' to 'yesC 
The opposite was the case with non-MACOS students at both grade levels. 'The ' 
relative direction of change was from 'yes* to • W . Fifth grade non-MAC OS students. 
* Were more likely to change their responses than to remain consistent. Again, the 
proportionate changes^ were in the direction of 'ntf (didn't study it).* ' 

Part b of Table IH-36 shows, for the students in each group that consistently 

: - 

^ — said-they^id stu^tJLkiUing-^nim.nls!-_hist^rearJji s oci a l s tu die s, t h e pieraegta ges of 



students continuing to say that subject did or did not bother them,^ and !he percentages 
of students changing; their responses- in effect from *yes' to 'no' or from a 'no' to 'yes*. 
While the percentages of students continuing to say they were not bothered are ^ 
roughly comparjible in each group, there appears to be a grade level difference both 

• * ' \ iikwo - . 

■ o • ^ ' ' " ' . • 



Table III-36 ' ' , • 

Responses of Students in Follow-up 2, Compared to Follow-«pl- 
to the Three Questions About the Topic Killing Animals , 
» ^ ..by Group and Grad6 



a*.. Did you 

Stvidy it? 



M 

NM. 
M ' 
NM 





In both Fu-1 and Fu-2 • 


Studied to 


Not Studied 


Jl 


Grade 


Studied 


Not Studied 


not studied 


to. studied 


5 


*67% 


10% 


• ... 9% 


13% 


. 286 




25' 


13 


36 . 


■ ' ..26 , 


• 256 


6 


,0. .61 


15 


7. - - 


17 


244 




> * 

20 


46 


21 


13 , _ 


209 



jb. Did it 
bother 
you? 



tC Should 
5th '6th 
graders 
- study it? 



Group 

M ' 

NM 



Group 
■ 11 

NM 

M 
. NM 



Grade 

.6 



5'- 
6^ 



In both Fu-1 and Fu-2 
^[ot 

B othered "' ' Bothered 

' 43% -23%. 
54 "28 



55 
51 



11 
17 



In both. Fu-1 and Fu-2 



Should 
Grade .Study , 



68 

73- 

60 



Shouldn't 
study 

6 

, 7 
10 



Changed from 
Bothered to Nob%othered 



not bothered 

22% 
. 15 
22 
12 



to bothered 




• Changed from 

Should to Shouldn't to 



'Shouldn't study 
14% ■ . 

11 . 
20 



should study 
13% 

9 ^ 
11 



■ iL 

192* 
65* 

150* 
41* 



N_ 
286* 
256 
244 
209 



1. M= MACOS, NM - Non-MACOS 

^Row percentages for this group are based on the number of students 
who consistently said (from Fu-1 to Fu-2.) that they had studied the 
topic . -Thus the N's are smaller. Percentages in all rows in the 
whole table may not "add tb 100% due to rounding. 



H'l-lSl 



' . ^ ' , ^ableIII-37 . . 

Responses of Students in Follow-up2-, Compared tOvFoUow-up l ^ 
\ to the Three Questions About the To-pic Leaving People toDie, by Group/-\^\ 

_ and GradQ <> ' ^, 



Did yovL 
Study it? 



Groupi''^ 
M 

' NM 
M / 
NM - 



Gra9e 
5 

6 



In both Fu-1 and Fu--2 
Studied Not Studied 



Changed from 
Studied to Not Studied 



not studied 



to stjidied 



49% 


24% 


17 - 


10 


9 


59 - 


22 


10. 


48 ^ 


28 


13 


ll' 


12 


54 ' ' 


19 • 


, 15 









In both Fu-1 and .Fu-2 


~ ■ Changed from • 


<- 






Not 




Bothered to 


■^Iot bothered 




Group 


Grade 


Bothered 


Bothered 


not bothered — 


-to bothered 


b.' Did it 


M , 


5 


°51% ' 


23% 


17% ^ - 


^ 9% 


bother 


NM 




57 


17 


^' " • 9 


17 


• you? 


M ^ 


- 6 


■ 66 ' 


4 


* 18 . 


13 , , 




NM 






0 


8 . 


> 








In both Fu-1 and JFu-2 


- . Changed from • . . 








-. 'should* 


Shouldn:t 


Should to,- - 


Shouldn't to 




Group' 


. Grade 


study 


study 


shouldn't Study 


should study 


c. Shduld . 


- ,,M 


c 5 , 


63% 


' 6%- 


23% . 




5th/6th 


" NM 




53 


11. 


27 .- 


9 


~ graders 


- M . 


6 ; 


63 . 


9 


20 ■ - 


• 8 * - 


. study it?". 


NM 




51, ,. 


10. 


• 30 . 


9 



l/* M = MAC OS, NM = Non-MACOS. . - ^ 

*RoVv percentages for this group are based^ on the number of students 
who consistently said (from Fu-1 to Fu-2) tnat'th'ey had studied the 
topic. ^ Thus the N's are smaller. Percentages in all rows in th§ 
whole table may not add to 100% du^ to^roufiding. 



'* , 



III-182 

209 



Table III-38 

Responses of Students in Follow-up 2, Compared to Follow-up i 
to the three Questio^is About the Topic ' Foods Different People Eat ' 
' by Group and Grade 



a.« Did you 
Study it? 



Group !/ Grade 
M. ■ 5 
NM 

'NM 



In both Fu-1 arid Fu-2 
Studied Not Studied 
72% 8 
61 9 

— -73_- 10- 

73 * 3 



* Changed from 
Stu4ied to Not studied 



not studied 
. IS 
. 18 

' "11 



to studied 
7 
9 

- 9 , 
. 12 



1), Did it 
C\ bother 
■- ■ you? 



c. Should <; 
5th/6th 
graders 
study it? 



Group 
M 

'NM 

M 

NM 



Group 

NM -"^ 

M 

NM 



Gra'de 
5 



In both Fu-1 and Fu-2 

Not ■ 
Bothered 

71% 

93 

82. » 



Bothered 
4% 
2 
2 
1 



, Changied from ' 
Bothered to Npt bothered 
not bothered 



.19% 

, 4 >' 
11 
1 ■ 



to botriered 

6% 
" 1 
5 

" 4- 



Grade 



In both Fu-1 and Fu-2 Changed from 

Should. Shouldn't -v Should- to -Shouldn't to 

study • s.tudy shouldn't study should study 

■92 ' 0 .4 - -3 . ^ 

89, 1 4. ^ 

^-^ 96 0 \ , 2 _ ,2 

~9'4^-^^- 0 ' 3 ' ■ 2 



1. M = MACOS, NM=-Non-MACOS. , 
=! Row percentages for this group are based on the number~of~student& 
who consistently said(from Fu-1 to Fu-2) that they had studied tHe 
topic. Thus the N's g.re:smaller. Percentages in all rows in the 
whole table may not add to 100% due to rounding. 



N 
^96 
267 
247 
215 



N 
214* 
171* 
180* 
158* 



■n; 

296 
267 
247 
215 
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Table in-39 ^ ' V 
Responses of Students in Follow-up.2, Compared J;o FoUqw-up 1 
' to the Three Questions -About'the Topic ' Starvation* ^ , 
by Group and &rade . ^ 



> 






« 


ChangecJ from 


c 


^ '■ 


• Group i 


Grade 


In botji Fu-1 anA Fu-2 
Studied Not studied 


Studied to - 
not studied 


Not Studied 
• to studied 




a. Did you ^ 


M 


5 


■ 48% 20% 


lg% 


14% 


. 290 


- " sfudy i,t? 


. NM 




38 22 


. 27 ' 


• 13 


• 260* 




^M- 


6 


40 29 


21 


10 ■ ^ 


247 




.."NM _ 




44 27-^ 


._^16 


12 . 


214_. 



In both Fu-1 and Fu-2 



b. Did it 
^bother 
^ you? 



c.Shoyld 
5th/6th 
graders - 
sjtudy it? 







r Not 




Group 


Grade, 


Bothered 


Bothered 


M ' 


5 


58% 


14% 


NM 




48 


14 


M 


6 


77 


7 


NM 




74 


8 






In both Fu-1 


and- Fu-2 



- -Changed from 

—Bothered to r —l^dtrboEhefed 
> 

rnot botheVed to bothered 



18% 
24" 
15 
■16 



11% 
14 

1 

1 



N 

lie* 

"95* 
96* 
85* 







• .Should^ 


Shquldnit— 


Should to 


* Shouldn't to 




Group 


Grade 


study ' 


'f - ,study 


Shouldn't studjf— 


. should study 


N 


M 


5 


84% 


; ■ 2% 


8% 


. . 6%" ' 


. 290 


NM; 




?77 


3 


11 . 


' -9 , 


' ?.60 


M 


6 - . 


84 






7- 


247 


NM ' 




~ 81 " 


> 0 


, - ■■ -;-i3 .'• 


- . • 6 . . 


214 



1. JVI = MACOS, NM= Non-MACOS. ■ .. 

*Row percentages for this group aje based on the number of-students' 
who consistently said^rom Fi^-l to Fu-2) that they had studied, the _ 
topic. Thus the N'*s are smallert Percentages in all rows in the ; 
wfiole table^may not add to 100 due to rounding. " ^ 



' * Table ni-40 - ■ 

Responses' of Students in Follow-up 2, Compared to Follow-up 1 
to the-Three Questions Al?out the Topic ' Treatment of Old People' . 
^, . . ■ by Group and Grade 



Ch; 



Did you 
study it? 



b. 



.Did it' 
'bother 
ypu? 



GrQup l/ Grade 

M . 5 >. 

, Nifr ■ / ■ 

- M^^ ' . 6 
MM 



Group 
M 
'NM 
M 
NM- 



Grade 
'6 



In both Fu-1 and Fu-2 
Studied Not studied 



38% 
16 
44 
16 



24% 
46 
• 25 



In both Fu-1 and Fu-2, 
. 'Not 

Bother^ Bothered- 

65% • • 5% 

66 - . 5 

-76 « 2 

77 * 6 ' 



from 



Studied to 
not studied 

12%^ 
° 20 

16 - 

28 



Not Studied 
to studied 

.27%:.^.. 

18 

. -15 
■ 16 



• changed from 
Bothered to Not bothered 
not bothered to bothered 



7% 
15 
7 
6 



22% 
15 
16 
11 



N 

2.93 
26(r 
244 
215 



.N. 

110*' 
. 41 
108* 
35* 



c. Should ' 
5th/6th- 
graders 
study it? 



Gr6up' 

M 
, NM 

-M 
- NM ' 



Grade 



In both Fu-1 and Fu-2 
Should Shouldn't/ 



Changed from - 
Should to- Shouldn't to 



study 
84% 
79 
83 
84 



. s tudy 
1% 
3 
1 

' 1. 



shouldn't study 
11% 
^ 12 

12 . 
11 



should tjtudy 

4% - 
.6 ■ . 

.4 

■ 4 •' 



1, .M= Mv^edS, NM= Non-MACOS. ' 

*Row percentages for this group are based on the number of students 
wtfo consistently said (from Fu-1 to. Fu-2) that they had studied the 
topic. Thus the N's are smaller. Percentages^ in all rows inHhe 
, ' whole- tabl« may not add to 100 due to rounding. 



293 
250 
■244 
215 



■ > » 



\ 
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Did 3mu 
study i 




• Tab^ni-.41 ■ ' 

Responses^of Students in Follo*v-up 2/Gompared to Foliow-up 1 

* to the Three Questions About the Topic ' Slavery * , - , \ 
by Group and Grade 



Group j/ Grade 

, ' 5 
* NM 

M-" 6 



In both Fu-1 and Fu-2 


studied to- 


Not Studied 


Studied 


Not studied 


not studied 


to studied . 


23%. ■ 


^ 45% 


2i% •_ 


10% 


■ 67 


11*' 


-"^ 8' 


14 


20 


' ■ 55 ' 


19' 


> 

7 . 


56 


17 . 




10 ' 




In both Fu-1 and Fu-2 





•* 




Not 




Bothered to ^ . 


Not bothered 




Group : 


Gride 


Bothered 


Bother^ 


not bothered 


to bothered 


b. Did it 


• M 


5 


63% - ' 




, 18% 


15% . 


bother " 


NM 




53 


13 


24 ^ 


11 


yoti? 


M 


6 


79 


6 ' 


13 


2 


* 

1 


NM 




• 68 


6 


5 


21 , 



N 
'60*' 
178* 

48* 
120* 



In both Fu-1 and" lFu-2 



Should 
5th /6th 
grgders 
study it? 



Group 

M 

NM 
. M 

■ NM 



Grade 



6^ 



Should 
gtu(3y 

" 80%' 
79 
84 
77 



Shouldn't 
' "gtudy 

2% ■ 

■ . 2 ' ■ 
4 



' Changed from .. - 

• Should to Shoulcin't to 
shouldn't study - ghould study 

12% " -~5%~ 

■ 8 ' 8 

* - 8 6 ' • 

14 . ^5 



N. 
2?4~ 
264 
243 
214 



*Row percentages for this group are based on the number of students 
Who consistently said (from Fu-1 to Fu-2) "that they* had studied the 
topic. Thus the N's are smaller. Percentages in ^11 rows in the 
whole table may not add to 100 due ^o rounding. 



-p. . • ^ 



fa MACOStittd non-MACOS groups in percentages of studAilts repeatedly saying 



r 



the subjefct bothered them. Proportionately more 5th gtaders than 6th> graders -* 
In both groups continued to indicate that the top iq bothered them. The difference 



• In perc^ntagi^s between MACOS 5th and 6th graders i? significant (X^ =7.909, • 

" ' ^ / 0 ^ 

^df=l, p^. 01); the difference, for tit^ non-MAG OS groups, ho\vever, is not 

significant (X^ = 1.039, df = 1, p> .30). Students who changifed their response • 
— from FoUow-upiLtoJFoUpwHOB^ liU the four groups; were proportionately 

o • ' - . ~ " • — - 

• ■* ^ • 

jjiore likely to change from 'bothered* to 'ngt bothered'. Non-MACOS 6th grade 

' •<» 

* «^ . " ^ * ' * 
students proportionately jmore often shifted their ifesponses in the other direction. 

• ' / . " • - 

The majority of students in alUtotarl groups indicated that they thought 

the topic wa^ age^ or grade appropriate. .Roughly comparable percentages of the 

•total number of students in each group changed responses .from FU-l to FU-2 in 

each'directlon,- although proportionately 'somewhat -more nofi-MACOS 6th graders 

shifted from 'shpuld' to "shouldn't study 

• .# » ^ 

The remai^ning^tablps can be interpreted in a similar.fashipn as a. " 
basis for^rrirving at conclusions about prevalences of topics studied within 
and between.MACOS and non-MACOS groups,, indications of impacts, and 
* opinions about the suitability of varioiis topics. There is, however, an issue 
that needs to be considered before^ ^uch ^interpretations and conclusions -are 
made. The issue is: dt> the percentages of students in Tables III-36 through 



^ - • • III-41 shown as changing responses in one direction or the other .froih FU-1 

'to adequately depict the^ significance of those change^? Consider in 

-86c the percentages* of students changing .from 'shouldn't' to 'should',^ . g 

ipe te^t 
istently 



Table III- 



77." O'hi-squape test here compared frequenciea of responses classified 
- . " — as consistently said 'bothered' vs. 'all other responses'. 



-III-187 . " 
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and 'shouldvto'shouldn't^ study <killing4inimals'. Eor mpst groups, the* • 
prerceotages appear about the same for changes ia each direction* Those per- 

s^Qtages, however, are based on the number of students in a given cat^ocy 
relative tp the total group. Suppose students are classified according' to their* 
original response in Follow-up 1. Suppose further that the Follow-up "2 ^ ■ 
responses of each of those groups are classified as 'same' or 'different' Uoip- . 
pared to their FoUow-up iVesponses. Suppose, finally, that one asks the 
question: '^are there differences in proportipns of change in response between 
the two groups?^ For^the MAC'OS 5th grade students in Table m-36c,,a,?table 

*based on that question would be as follows: ' * - * \ ; • 

Follow-up 1 V - Follow-up 2^Respoase* 
^ * Group > Response' . - Same ^ Different ' N - - 

^ ' "MACOS* Shouldn't Study ^ ' 24%(12) * • 76% (38) 5t) - 

Grades ShouW Study ''83.(197) , 17 : (39) ' 236.'^ 

' ■ . A • % \ • • ' 286 . ' ^ 

^uift)ers in garentKeses are frequencies. ^ , * ^ ^ ^. 

This table shows \that while ^e same absol^ute murriber of students in. each 

group (as de/fned by their resp6nses in Follow-up i) changed responses/ students who 

'Originally said''shouldn*l' were 'proportionately far more likely to reverse their 

i« c f < f » 

responses in Follow-up 2 than were*students who originally said 'should'. The 
Chi-square test for that table is highly significant (X^ = 71.186, df 1, p< •01).'''® 



78 . The frequently used test of change proposed by'McNemar tes^ the . 
hypothesi s that the n umber of changes in- one direction is not different ^ 



from Oie number 'ipf changes in the other dire^'tion. In the present 

, e^cample, tlie Mcl^emar x2 = . 013, df = 1, p>. . 90. \i does not take into 

account the fact that the^two originally defined groups were of very . 

different si^es (50 vs, 236)^ If group "sizes w^re equal, the McNemar 

x2 for*bhange .and thtfon^. computed for the 'Illustrative tSble would bemore com 

^. parable.- J'or the McNemar X^, see McNemar, Quinn, Psychological 

Statistics^ New York- John Wiley Sops, 1949- The X2 computed for the " . 

illustrative table was, in cohventioRal notation: 

* 2 f o ^ — 

. ^ X = N( I AD.-BC| -.5N) % 

' *(A+B) (C+D) (A+C) (B+D) . \^ ^ 

' \ » • 'III-188 
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In effectt in response to the questiont ''!even If you personally did not study these 
topics in social^studies last year, are there any of them that you'think^Sth or 6th 
gr^e fclds should not study in social studiesft students' were much mx)re likely, 
proportionate to their numbers, to go from 'yes, I think they should not, to 'no, 
I wouldn't say that about killing animal^,' than from 'no' to 'yes'. . * " ^ 

To aid in Interpreting directions of change for all'lopics^and questions, 
the change used ^buve was computed. Since three questions were asked of each 

{oplc, *and since there was interdependence or overlap between questions and • , 

• ■» • ♦ • • 

.respondents in different categories of response to different questions, it was ^ 
^deqlded that a conservative approach to decisions about jsignlficance of .amount? 
and direction of change was appropriate. Thus,'^ to maintain a topicwlse Type I 
error* rate of .05, the Bonferroni procedui;e was employed to establish^a critical' 



■ value for the'Chi-square test ofoeach question withirfa topic. Thus, a p-value of . 
\65/3, of . 0167 was taken as the significance level needed for egch of the three 
tests 5ndiyidual)y for a given'lgroup and grade level. The associated critical ^ 



value of the 'S 5. 731. The Chi-squares for each topf-p, question and group 

areigivenvin Table III-42. - The table givps the directibi*of proportionate change, 

as describe^ above,* whenever the Chi-square is significant. The table alsp ^ 
•» 

- . • . . , 

giv'es the results of the test of-tlte hypothesis that MAG OS and non-MACOS 

students were proportionately equalljMikely to change* their responses (In either 

'direction);'^ In the event that one or more cells had an expected frequency of 

less than S, no test was made. The situation that always produced that con- 

ditibnjyas that tlfc number of students in, one or both initial groups (defined by 



' . ^^^\ For thos'e tests, the Bonferroni procedure was not applied to determining 
significance.^ The rationale was that-wHilf? the questions were related 
within a topic, the groups were independent. , ' 



2U 



^ ^ Table III-42 

' Ghi-Squares of Tests of Differences in Proportions of Students 
Changing Their Responses From Follow-up 1, and Direction .of Changei/ 



MAC OS VS. Nofi-MACOsi^5th Grade" 



MACOSl'^. 



Non-MACCXSS/ 



6th Grade 



5th Grade 



'r'' .Topic 



6th Grade - 



I 



Question ^ 3? 6th gr; 3? 6th gr. X iDirection X Direction X Direction X- Direction 



Ktlling Animals 



1. *' Did you shidy it? JL73 " /5.739 

2. Did it bother you? '4.467*' .008 
A: , Should 5th/6th . .130 '5.595* 
graders gtudy it? _^ [ 



55.151* 
1*5. 609* 
71.186* 



Yes 

No 

Yes 



19,052* 
33.889* 
33.908* 



Yes 
.No 
Yes 



13.592* , No 
7.817* No 
39.173* .Yes 



17.304* 

NT 
11.057* 



No 



Yes 



Leaving people 
to die " . 



1. Did you study it? , 1.233 . 4.989* 

2. ' Did it bother you? .058 .063 

3. Should 5th/6th 1.694' 4.787 
graders study it? 



1^.' Did you study it? 
2. Did it bother you*? 



'..563 
ll."865* No 
9.04 * sYeg 



1.49 - 
36, 925* 
6.502* 



No 

Yes 



80.688* No 
NT'. 
1.428 ' - 



27.185* No 
NT " 
.669 



Foods that , • 
different people 
eab 



.3^hetrid-5th7'i6m ' 7684 
graders study it? 



3.506 \ 2.094 

24j^33i_Ji_8a35*- 
" ' ' -.106 



23.014* Yes 

-:^875* — No" 
NT - 



J7._464i. 
NT 
NT 



.Xes- 



-24;-852^^--Yes 
. NT'" ' - 
NT" 



"^3.733* 




.'Starvation 



Did -you study if? -3.103 

2. Did 't bother youV ' 1,744 

3. Should 5th/6th* ^3.800 
graders study it? ' ' ■ 




6. 199* Yes 
22.'737* ^. No 
NT 



1.829 
NT " 
NT - 



NT - 
14.912* 'No 
57.732* Yes 



Treatment of 
old people 



1. Did you study it? .013 ' J).450*'* 

2. Did it bother you? .032 1.62 
^3. Should 5th/6th ' .729 " ' \.038 
graders study it? ' 



g7.779* Yes 
NT . / 
NT \. 



2. 695 
NT 

NXJ. - 



17. 436* No 

NT- ' , - - : 

NT 



23.6«<at^, No' 
NT - 

NT ■" 



Slavery 



1. Did you study it? 

2. Did" t.bother you? 

3. Should 5th/6th 
graders study it? 



7.159* 1^144 
. 001 1.1878 
.29-3 .1.522 



27.885* 
.NT 
, NT 



No 



41.46A- 
NT ■ 
'NT ' 



No 



55. 876* Yes 
39.762* -No' 
63.8_34* ...Yes 



3. 088 
NT- 
NT. , 



iad an-ex^edti 



1. NT means no test was made because a ceU had 

2. For Chi-squares in these groups', • . " 

.* *p <• . 05 

*.*p ^:oi, 

*P £ . 0167 (see text) 
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d frpcjuency of less than 5. 



/ 
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responses in Follow-Up 1) was small. That often was the case especially with 

resi^ect to the questions about being *bothei*ed by a, topic, and about its'^ita- 

.bility/ For most of the topics, most students were not bothered, if they said 

they studied it both in Follow-up 1 arid Follow-up 2; similarly, most students 

did not express the opiaion that the topic v^as unsuitable in jeitKer follow-up. 

The following are the main findings derived from the data.in Table III-36 

through - , ^ . > 

. , « * ■» 

a) Differences in prevalences pf topics studied 

^ . More MACOS than nonrMACOS students at both grade levejs 

studied tilling animals,' 'leaving people to die,' and 'treatment^ ; f 
> of 2ld people', according to Follow-up 1 and 2 responses. ^ ^ ^^f 

' - .More non-MACOS than MACCS students at both grade levels 

studied 'slavery'. , ^ 

- .Similar percentages of students in both groups studied or ^ 

learned about 'foods that different people eat' and 'starvation. ' ^ 

These differences are consistent with content differences between MACOS 

and other curricula. None of the 6 topics listed, however, was completely unique 

to MACOS or to other social studies programs. Jijdging by the small percen- 

tages of non-1VLACOS students who consistently said they had studied 'leaving 

people to die' (9-12%), that topic comes closest to being unique when stated to * 

students in a generalfzed form.. Abouf 50% of the MACOS studentsfelt they recognized 

it as somethingthey had read, seen,or heard about last year in social studies ; 

few non-MACOS students did. 

80^ The results .pertain to the approximately 80% of the students who were 
in Follow-up I and Follow-up 2. The results presented in the tables 
are for about 1, 000 students who made no errors in completing ques- 
tions in'^both follow-ups. 
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• When compared with each other, lyiACOS and non-MACOS 5th 
or 6th grade groups in four cases changed their responses from 
Follow-up 1 tq Follow-up 2 at proportionately different rates 
with respect to whether topic had been studied. . Within dif- ^. 
fer'ent /groups, there were even more frequent significant r^a- ^ ^ 
tive shifts of responses. Significant relative ^changes of responses 
were mainly nonrMACOS students changing more to saying they 

. had not studied the MACOS related topics ('killing animals, ' 
'leaving people to die,' and. 'treatment df old pebp,le'); MACOS , 
students shifted responses to 'no' with respect to.a predomi- 
nantly non-MACOS related topics, '^slavery'; and all groups 
changed to 'ves' with respect to the general topic, 'foQds that 
different pi^le eat. ' ? * - ' 

The trends in changes are interpreted as suggesting that some students 

initially reacted to affective qualities jof the topics, as listed, and itt- Follow-up 2 

reacted more to this implicit substantive, content of topics in relation 'to memories 



of the prior year's social studies class. " . " , * 

Suggestions, of the potency of different topics 

..For each of the 6 topics, nearly all MACOS and non-MACOS 
* 5th. and 6th^rade groups had'at least a few students who consistent 

ly (in Follbw-up 1 and Follow-up 2) said they had studied the 
topic *and it bothered them. The one exception was npn-MACOS 
'6th graUe students with respect to 'leaving people to die. ' None 
of the 26 students who consistently said they had studied it also 
- " said both times that it bothered. them. The majority of those 

26 fetudents (69%) consistently said 'not bothered. ' 

. Fob all topics and groups for which there were large enough 
san ple^ to make tests of significance of'relative direction 
of ciange of response, significantly larger proportions of 
- students changed from 'bothered* to 'not bothered' than in the . ^ 
other direction, given the relative sizes of those groups. " ' 

^ Witl two exceptions, the majority of students in all groups, con- 
sistently said Tiot bothered' for 'each t^pic. The exceptions were 
MAC OS 5th grade students with respect to the topic 'killing 
anirtals', and 5th grade non-MACOS'students wrth respect to 
'staiivationl ^ 
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. The topics for which the largest percentages of students in all 
^ groups consistently indicatpd ^not bothered^* if they consistently 
said th^y had studied it, were » foods' that different people eat' 
and ^treatment of old people*. 

The topics for which the smallest percentages of sf;udeats in 
'all groups indicated 'not bothered' were 'killing animals' and 
^^Jeaving peopleio die*. Relative percentages of students Jadl- 
'cating'not bothered' for 'starvation' appeared related fo grade 

level rather than group (MAC'OS'ot non-MACOS). 

.'Of the cases in which tfeere were large enough sample sizes to 
test, only two showed a significant grade level difference within 
MAC OS £xc within non-MACOS groups. Significantly larger per- 
centages of 5th grade than 6th grade MACOS students consistent- 
ly said they had been-bothered by 'killii^ animals' and 'leaving 
people to die'. There were indications of greater impact of 
• other topics on 5th grade students thati on 6th graders ia both 
^ groups. The differences in percentage either were not signifi- ^ 

• . cant,, however, given sample sizes, or not testable by the jne- 

*thods and ground rules employed. 
• « 

.While topics vai*ied in potency, sometimes in relation to general 
curriculum groups, sometimes according to grade level, some- 
times both, the general trend from Follow-up 1 to Follow-up^ 2 - 

. was,a diminishing potency, as suggested by consistencies' and 
chj>ages in responses to the question about being bothered. ^1 

.The maximum absolute fraction of students in any group that were 
consistent in saying they were bothered by a tppic, if they also n 
were consistent in saying they studied «t„ was relatively small (no 
more than 11%). • ' " 

c ) Opinions about suitability of topics 

. The l argest percen tages of students in both groups and ^ade" 



levels consistentlyindieoting they thought 5th_and 6th graders 
should (or at least could)' study ^pertained .to the topics 'foods 
different people eat' (89-969o), 'treatlnent of old people', *star- 
vation', and 'slavery' (all the latter in the range of 77-84%).^ , ' 



81, The reader is directed again to Section V B7, in which a report of,, 
interviews with students following administration of the Follow-up.l 
instrunient is given, the datuirjcportcd and summarized here bear 
on that r-eport, and vice vers^\; ' \, , ^ 
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".Topics which the smallest percentages of students consistently 
indicated as suitable (did not indicate 'shouldn't study') were , 
'killing animals^ (60-^3%) and 'leaving people to die' (61-63%) 

.With respect to* 'killing animals', afi- groups and grade levels 
were significantly proportionately more likely to shift from / 

- 'shouldn't' ta 'should study', given their original positions in 
Follow-up 1. - ^ 

• • With'respect to 'leaving people to die', MAC OS 5th and 6th 
grade students who originally" indicate 'shouldn^t study' were , 
significantly more fikply to shift in FQllow-up'2 to 'should' than^ 
those who started witlr ' 'should' were Ukely to shift to 'shouldn't'; 
That was not the case for non-MAGOS 5th and 6th graders, who 
• were equally likely to shift in both directions. Few members 
of those two groups, however, "consistently said they had studied 
♦ the topic (23 5th graders and 26 6th graders). 

.When any group changed itfe opinion from Follow-up 1 to Follo\y- 
up 2, and a test could be made of the significance of proportionate 
change in one direction or the other, all significant changes* were 
in th§, direction of 'should study', rather- than 'shouldn't study'. 
This is interpreted as further evidence, of thadiminishing of im-' 
pact of any topic over time, possibly influenced by intervening , 
learning, on non-MACOS as well as MACOS students. 

d v General imprcss'ions . ^ . * ^ 

.,Efmotibnal reactions or negative opinions about various topics 

- appeared to fade or diminish fi?bm Follow-up 1 to 2. 

.Some, topics or issues faded more than others, suggesting less 
centrality of some topics on the one hand, and the effects of 
mode of presentation on the other. A case, in point is 'foods ^ 
different peo^ple eat' . _ In FQllow-rup l,-^foi?mer .MACO& students^ 
were still much aroused (positively or negatively) over Netsilik 
Eskimos eating fish eyes^and the like. By Follow-up 2, a year 
after the course, few former MACOS students were willing to 
indicate concern on the questionnaire.^ The predominant shift was 

. from bothered to not bothered. More serious topics, such as . 
'leaving people to die', 'slavery', 'starvation', -and 'killing ani- 
mala* appear to hgve.hnd more lasting effects with more students. 

.Short term impacts appear easiex^la achieve with 5th graders thar 
6th graders. ■ ' - 
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. No^inference from these data can be drawn abouf^psychological \ 
effects beyond the substance of the questions asked.. If students 
said they were bothered and wished they hadt^t seen or read or 
heard about such things, that*is a statement, not a diagnosis. ' ] . 
Students differ in maturity and perspective.^ Furthemore, thfere / 
is good reason to be b9ther6d about some matters. Bothered 
does not necessarily connote ^dammaged', however defined, 

.Considering the general thrust of social studies toward involve- * ^ ' 
ment of stujdeats' attention and interest in important. issues and 
problems," the data suggest it is not easy^to engage young students* 
minds and emotions in an enduring iashi on, no mlaffer what the 
curriculum and mode of presentation.— 

4 ) Opinions of Last Year's Class in FoUow-up 2 V 

Overall, what did students think of last year'js social studies class a year 

. ' ' " / . - , 

later? Their global opinion.wa§ sought in Follow-up 2. In the context of several 

questions designed to help students recall last year's* class, they were ask^ed: 

"Still think about LAST YEAR'S social studies class - what you 
studied apd how you studied it. If you had a younger brother or 
sister coming along, would you recommend that he or she.take 
tbe same so6ial studies course that you had last year?" 

z Students responded on,a 4-point scale ranging from 'definitelyTIo' to 

•definitely yes'^. The responses of all ''students in Follow-up 2 were tabulated, not 

just those of students who also had been in Follow-up l'. The results are given ,^ . 

irf Table 111-43 for each group and grade level. ; - 

Table III-43 shows that the ^majority of students iti-all four groups responded 

on the positive side of the scale. The two questions of further interest, however, are: 

. were MAC OS students at a particulxir grade level more positive 
. in their attitudes tqward last year's class than non-MAC'OS 
students at the same grade level? \ ' 

• was there difference in attitude between 5th and 6th grade students 
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Table IH -43 

Percentages of Students Responding to Question About 
Recommending that a Sibling Take the Same Social Studies Coursel/ 



Grade 5 

■ M'ACOS 
Non-MACOS 



Grade 6 
-MAC OS 
NonrMACOS 



6%, 
15 



Definitely No " I Don't Think So I Guess So * Definitely Yes 

• 11^0 ' - 12%" " " 47% " • 30% 
20_ 19 37 23' 



. 11% 
' 17 ' 



41% 
49 



42% 
20 



•2/ 

NoData^ ' N 



356 

309 ' • 



311 

276 



1. Percentages may not add to 100% due to joutiding. 

2. A dash (-) indicates less than . 5%. 
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' ^ * in the MACOS groUp or in the non-MACOS group?^^^ ^ 

Table ni-44 gives the means and standard deviations for the four groups 
of students. "It also shows the pdint-biserial correlation coefficient (rpbi) 
for. each comparison made in order to provide a measure of strength of relation- 
ships between group membership and ratings. It can be seen in Table ni-44* 
that the average ratings of MACOS Itudents were jmore positive than those of« 



Boh-MACOS students, more so for 6th grade students than 5th grade students. 
Chi-square Fests were made of the differences between distributions of. responses 

for each pair.of groups for which a point-biserial correlation coetfficent was 

• . ^ o ' ' ' 

compTite^. ^All Chi-squares were significant at or beyondthe. 05 level. While 

^\ * ' ' ^ • - • 

the difference bet\yeen each pair of distributions of rating'S~iflr significantly dif- 
ferent from chance, the point-biserial correlations indicate that with one ex- 
-ception,.the correlation between group membership and ratings is small. The 
exception is MACOS; grade ^ compared to jion-MAGOS, grade 6. There the 
p^int-biserial correlation is .25, substantially more strength of association 
than shown by other groups. 

* As a means of maintaining perspective on these resulfs, one cV also 
exiimine the index of predictive association for each pair of .variables.^' Sup- 
pose one asks, in each case: What vvimld l)e the reduction in error of prediction 
of recommendationj:5ithTgs7knowing group ^^nd grade level? What would be the 

82-*^ should be remembered that students ulsentified as 5th and 6th graders 
^""""^^ , here were in fact finishing 6th and 7th grmle, respectively,: at th^time 
'they were administered this survey, \ 

8.3. CI. Haves. William L. , Statistics for Psychologists . New York: 
' Holt, Einehart aria Winston, 1963. pp. 606-610^ 



Group ' 
MAC OS 
Non-MACOS 

MAC OS 
Non-MACOS 



Grade 

5 

6 
6 



' - t , Table IIt-44 • • . 

Means and Standard ^Ratings of Rfecommenaatioas of LastiYear's Class, 
by Group and Grade, and Point-biserial Cforrelations-pf Between Grodps 
by Grade, and Between^ Grade Levels Within Groups 



N 


Mean 


SD. • 


'356 




.93 


308 


2.6 


1.05' 


310 


.3.2 • 


.86? 


276 


2..7 


.94 



Point biserial Correlation Coefficients for : 
^5rade 5 Grade 6 MAC OS 

MACyps/Non-MACOg 



MACOS/Non-MACOS 
.08.r-..». ' 



25 



Grade 5/6 
•-.07 



.percentage 'of teductiyn of error of prediction of group, membership, knowing 

ratings? What would t>e t|ie percentage d£ reduction of error in predictiou - 

. of one or the other variables C^lassification, ratifigs), knowing both variables? 

* 1* * 

The measure us^ to answer the first question is calledM (lambda A). The 

measure uged to answer the second question Ys^c^lTedTCB." The measure us^d 

to answer the tHir4 question is called A AB. The first twx) are known as ^ 

'asymmetric' measures of predictive association; they are like regression 

coefficients. That is» A A may not be tjie same as AB. The latter is known as 

a 'symmetric' measure; it is similar in that respect to a simple correlation 

* • »■ 

CGefficient>i'n that the correlation of A with B is the same as the correlation of 

B with A. Table III-45 gives the asymmetric and symmetric indices o£ predic- 
tive association for different prectors and criteria. 

The information in Table III-45 essentially confirms the information, 
in Table III-44. There are differences between groups and grade levels in ' ^ 
ratings of recommendations of last year's social studies class. The differerices 
are statistically significant, but modest with respect to strength of association 
as measured either by correl^ition coefficients or^by indices of predictive ass^o- . 
ciation. The difference in ratings is most pronounced between MACOS and nony^ 
MACOS Qth grade students, with MACOS 6th graders giving the most positive 
ratings <30mpared to apy other groups and Aon-MACOS Glh graders giving Iqss 
positive raUngs. Considering MACOS and noji-MACOS 6th graders, ij one knew * 



\ 



only ratings students made, the reduction in error in predicting group member- 
ship \yould be 15%. That is the largest reduction of error of prediction of any 
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. Table m-45 
Percent Reduction of Error of Prediction 
otRecommenclation Ratings from Knowledge 
of Group, or Group from Knowledge of Ratings 



Brediction of kk - Prediction of . '.^^ Joint 

Group nnd Ratingsjfrom Group • Grouf) from Ratings Prediction 

Grade Levell^ AA^^ ^^ X B ^ XAB ' 

M5, .M6 • "0%*' ^ -8%/ " . 4% ' 

NM 5, NM 6 " ' 0 • - 7 ' ' - • 3 * 

M5, NM 5 . 1 * 12 , 5 . ' 

M6, NM6 . 1 .15 ; 7 

M, NM ' ■ 0 ■ . . 12 § . 

Grade 5, 6 0 " ' ' » 1 * v 1 . 

1. M = MACOS; NM =,non-MACOS;"5,= 5th-grade; 6 = 6th grade. 



f •> 
I 



r 



/ 



' 0 



it 
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combination of groups. However, the index of predictive association for 
predicting group membprship at the 5th grade leyel is nearly, as large (12%). 
It is therefore not surprising that the index for predicting gi^up membership, 
(MAQOS, non-MACOS) regardless of grade level, from a knowledge of ratings , 

\ 

is also relatively hijgh (12%), • 
■» . 

From these analyses it is concluded, with respect to general opinions 

• ' » *' 

about last year'5 social studies class held by students a year after the class, 

t|iat?- ■ " , • . 

• the majority of students in all groups held positive opinions; 

. former 5th and Sth gra'de MAC OS students, on the average, had 
^more positive opinions tha1i non-rMACOS students at those grade 
levels; ; - " 

• the differfences in opinions between grade levejs of students 
within each group were smaller than differences between 

.groups at each ^rade level; ' . 

• MACOS 6th grade students, on the average, held the most 
favorably opinions of all groups of students; 

. Non^ACOS 5th grade students, on the average, held the least 
favorable opinions; . / 

• differences between MAC OS and non-MACOS students in degree 

^ of positive opinions were statistically significant but functionally 

small with respect to overall strength of association of ^bpinion 
with^group (i. e. -MACOS-, non-MACOS).. / 

_ - ■ .\ ■ . " ■':■/■ 

. ♦ ■ ■ •- . • / 
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g.- School ana District Effects 

1) lOistricts i * 

How did districts compare with each other with respect to performance 

on various outcome measures? Were there interactions of district and curriculum? 

That is.^ did MACOS'and non-MACOS classes perform differently in different 

districts? To examine those questions, a two-way- analysis of covafiance was ' 

• *i » 
done, withposttest measures as dependent variables, and district and group 

(MACOS, non-MACOS) as independent variables. The covariates were pretest 
and percentage of 5th grade students^^The tests were univariate F-tests. The 
unit of analysis for each measure was the class mean. The results are sum- 
marized in Table III 46., - which gives the p-yalues of the tests of main effects 
and interactions for each posttest variable. ^ - 

It may be seen m- Table that ^vifh respect to the IVIACOS vs. non- 
MACOS variable, results are similarr to those obtained in earlier analyses of 

covar.iance and multiple regression (see Section III C 3b)'. That is, MACOS classes 

\ • ■ 

on.<tlie average were higher on' posttest than non-MACaS classes on AP (the M^COS 
Specific instrument). They were not significantly different from np,n-MACOS classes 
on other measures with the*exception here of W'WA and B, the questionnaire about 
attitudes towards customs.or beliefs, and people. That difference will be discussed 

below. ' . ' ' ' ^ ' ^ ■ ^ 

There are district effects for three variables: AP, IDT; (the Intcrpi'etation 
• of Data Test) and WWA. There are significant district-treatment interactions also 
for three posttest measures: STEP, SS Ch, (social studies choices), and CAPS-3 
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Table 111-4(5^ 

P-Values of Univariate F-Tests of MACOS Effects, 

District Effects and Interactions Between 
* MACOS and District for Posttest Measures - 
' Adjusted^ for Pre-test and %. 5th Graders,;. 



/ 









lyloCX. lot HiJlJLCvxL 




Posttest Variable 




(df=1.76) 


(df = 14, 76) 


((^£=14,76) 


Animals and People (AP)i/ 


. OOIf ** 


.014** 


.,471 


STEP+ 




.336 


■. 541 


.043* 


IDT 




' . 249 , 


.'002** 




SS Ch . 
WA-^ 
VJWB- . 




. 087 I 


.84& ' 


- 015* 




.009** ■ 


. 039*^ 


. 081 




.046* 


.676 


. .227 


CAPS-1 




.189 


.103 \ 

. 796 \ ■ . 


' .299 


CAPS-2 




. 158 


^ . 899 


CAPS-3 




.325 


.096\^ 


.033* 


CAPS-4 




.116 . 


. 680 0 


.844 



. - - ^- 

+The error degrees of freedom for this measure are 73. 
*p^.05 

**p^.01 - ' • . . • >■ 

***p^.ooi 

Note: As in most tables presenting p-v^lues, those values that are .05 or less 

are denoted by asterisks as a visual aid in identifying variables of particular 
interest. 



1. MACOS classes on the average scored higher than non-MACGS classes* 

2, ^ MAG OS classes on the average had mote positive reactions than non-MACOS 

classes. ' • 



\ 
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(toleraace of ambiguity in problems). It may be noted-that for those posttest 

' ' " ' 

variables for which there were significant main ef|efcts (p < . 05), there were 

not sigaificant Interactions. * " . « 

District effects were analyzed by application of Tukey's WSD test at 

the .05 level for least significant differences between'all pairs of means- This 

procedure led to.an Identification of districts whose adjusted posttest means 

differed significantly. Such an identification provides the opportunity to examine 

^relationships b(^weett significantly different districts and other variables, such 
as metropolitan status> size, policy, ^imount of implementation of MACOS, etc. 

Such analyses have not been pursued in detail. It will simply be noted 
that the districts that were significantly different for the MACOS posttest {Ap) 
were 12 (low), and 9 (high);';for the Interpretation of Data Test (IDT), district - - 
12 (low) differed from districts 6, 8, 9 and 10 (highs), and district 1 (low) differed from 
district 10. However, for WWA, .the districts that differed were 4 and 8 (lows) and 15 

" (high). In effect, the s^rae district that was low for IDT (#12) was also low for 
AP, while that was not the case for the othdr low district for TOT (#1). FurtKermore, 

' one of the districts that was relatively high for IDT (#8) was low for \V\VA. The 

district that was high on AP (#9), was near the top on IDT. It was about in tlie 

center of the distribution on'WA posttest. There was thus some consistency 

of standing of high and low districts within set3 of measures (e. g. the achievement 

measures vs. the attitude measure), but not across sets. 

IP 

The three variables for which there were significant interactions (STEP, 
SS Ch and CAPS-3) also of cojirse indicate district effec^ts. As before, examination 

' . . • ' :\- . . 
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of adjusted" contrasts (intercepts) showed that districts with the high and low 
contrasts for the STEP were not the same districts with high aad low contrasts 
for the attitude measures (SS€h and CAPS-3). Once again there appears to 
'be^n4ndependence of achievement and attitude in the.small sets, of classes 
standing for different districts in this study. 

'The finding of significant differences for \^WA and WftB requires 
further analysis. Earlier multivariate analyses, described in Sections IJI C,3b 
1) and 2) showed evidence that MACOS classes, on the average^ tended to react . 
more positively^on posttest than non-MAC'OS classes to WfJA. However, there ^ 
was no indication of a differentiation between groups on posttest 09 \\WB. 

' There are several possible reasons fpr the disparity between the 
analyses of districts and earlier analyses of classes. One is that earlier 
analyses dropped several classes for which there were missing data, even 
considering analyse?. using. only student-based PC's. The pre^nt analyses 
employ all 108 classes, except- for STEP, for which N = 105. -Thus, there 
maybe samj^e variations thaf result Jni;he difference. A second possibility is 
that the anaKses of district effects used as c6variates the percentage of 5th 
graders in cKi^ses and the class pretest mean of each posttest variable. The 
jnain analyses presented earlier used principal components (PC's) as covariates. 
Differences in covariates could influence results. 

One means of investigating possible explanations is to compare the p-values 
of F-tests of analyses of covariance based on the same sample sizes and co- 
variation, but not contrasting districts, with the p-values of analyses of covariance. 
using principal components with similar sample sizes and different^ sample sizcst 
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to the district analyses. The p-values will reflect variation In means, variances 

regressions sad sample sizes. Patterns of consistent or varying results ^ 

* / . 

can bear on, choices among competing hypothesis. Table III-47 gives the 

■p-valttes of F-tests of analyses of covar.iance of posttest variables JSot: 

. MACOS vs. non-MACOS effects in district analyses*(frQi 
^ Table'nM?), N= 108; 

/\ MACOS v,s. nog-MACOS, with pretest and % 5th graders 
' covariates, N = 108; " - * ^ 



' . , MACOS' vs. non-MACCS,, with -8 student PC's - input, process 
and climate - as covariates (from Table ni-47), N = 102; ^ 

.MACCS vs. aon-MACOS/with 8 student PC's as adjusters 
(from Table in-47,N = 81. . 

It may be seen in fable III-47 that^the two-way analyses of covariance . 

,(the MACOS by District analyses. Column 1) and the one-way analyses .of 
covariance (Column 2) produced very similar results, the only marginal 
difference of interest i'^ with -^^^'B, which for the district analysis has a p-valiie 
of .046 and for the one-way analysis has a p -value of .058. Column 3, with 
nearly the same sample sizeas analyses represented in Cblumns 1 and 2, 

. shows different results/ Overall, the results in Column 3 (analyses of covariance, 
using student-based PC's as covariates) are more similar to results in. Column 4 
(same covariates, reduced sample size) than to the result's in Columns 1 and 
2. ^\^VA and B d^a^not^ achieve' significance at the . 0_^5 level when posttest ctoss ' 
means in the two groups are adjusted f^ input^^pfocess and climate IPC's. 
CAPS-1, on the other hand, is*significant at the .05 level in Column 3, and 
nearly so in Column 4. - ^ ' ■ . ' 

' ' <» " ' 
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Table ra-47 ^ ' . 

. P-valucs of F-tests of MAC qe Effects 
in Analyses of districts, and of Analyses of Covariance 

Using Difiorent Covariates and Sample Sizes f\ 



Variable 


1 

X 

MACOS vSi ^ 
Non-MACOS in 
-District Analyses 
{N=108)i/ 


2 

-MACOS Vs. " 
Non-MACOS 
Posttest Analyses 
(N=108)i^ 


3 

MACOS vs. 
Non-MACOS 
Using Student PC's 
(N^102)3/' 


4 

MACOS: vs. 
Non-MACOS 
Using Student PC's 
(N = 81)4/- - 






.000 


' .000 


.000 - 


■'■■STEP 


_ .336 , 


.396 


.310 . 


. . 548 


IDT 


.249 


.125 


.244. 


* .611 


- SSCh 


.087 


. 227 


.367 


. 981 


WA 


.009 


.025 


. 161. . 


. 090 - 




. . 046 


.058 


; " . 509 


. 666 c 


CAPS-1 


.189 


.215 


/ .035 


.065 * , 


CAPS-2 


i, .158 , 


.100 , 


.720 


. , 538 


CAPS-3 


- ' . . 325 


.225 


.839 . . 


.889 


CAPS-4 . 


.116 


.527 


.295, . " ". 


.300 » " " 



1. Covariates; pretest and % 5th graders. (Note: for STEP, N = 105). 

2. Covariatesr pretest and'% 5th graders. (Note: for STEP, N = 105). , 

3. .Covariates: student input, process and climate PC's. 

4. Covariates: student inputs process and climate PC's; - 

C - " ' * - > 




It will be recalled from Section III C 3b 1) abov^ tliat A^WA sliowed 
heterogeneity of regresi^ion with Climate for botli the large and reduced sample 
(Figures III--2 and 3). it will also be racalled that WA and ^(wB both showed 
significant increments in proportion of variance associated with process vari- 
ables in multiple regression analyses entering Group lastr CAPS-1 showed 

» 

a significant increment associated with Climate (See TaB^*TlI-17; also Table III- 

20, id which Group was enter^ed after input), STEP was also associated with 

** , ' ^ «j 

' . . ' - - *. > ^ 

Climate, as was SS Ch (social studies choices). However, unlike \^WA, WB 

and CAPS-1, for which only 52-67% of the total posttest variance accounted for 

was associated with input, 97% of the "STEP variance accounted for was associated 

with input* Thus, there \<^as li};tle variance left to account for in STEP once . 

input (primarily Ach, or pretests) was removed. | 

■ It thus appears that the differences between results in Columns 1 and 

2, on the one hand, and Columns 3 and 4 on^the other, maybe viewed as attribu^ 

.table primarily to the use' of different coyariates rather than to varia^ons in 

sample sizes. This does not mean that variations in sample sizes (and therefore 

sample aompositions) have no influence on results. They can and do effect results. 

' The interpretation here is that for the variations under consideration, method 

of analysis appears to be the more potent factor. 

It is.of interest to note that the [Posttest variables that were influenced 

^{•^ 

importantly by changes in method of analysis (or in sample sizes or both) are 

variables in the attitude set, not in the achievefment set. No major conclusions 

84. It may be noted that there were no 'heterogeneous regressions for any 
analysis in Columns 1 and 2 in Table IIM7. . - 



^ 



about differences between MACOS and non-*MAeOS gr.oups of qjaeses 
wlUi respect to AP, STEP and IDT have been influenced by method of analysis, 
including which. variables have been used as statistical cdntrols. ^ 
2)' Scho61s \ _ " , \ l ' 

A design goal of the study was to have only one cjass {MAC.08,pr 
non-MACOS) in a particular school building. The resultant-samples niade that 
goal unattainable, as described in Section HA. There were 108 classes m 76 
different schools, or an average of i: 4 classes per school. , I'able HMS shows 
' for each groug the number of schools with 1, 2, 3 or 4 classes per school. With 
the exception of two pairs of classes in two schools; 'the dlasses that were grouped 
ina given school were either MACOS. classes or non-MAQOS classes:, but not ^ 
both types in the same school. The question of primary concern is: has the 
' iiestiiig of some classes in schools influenced main results? - 

To explore that question, it was hypothesized that if the posttest HxA 
follow-up measures for which there pretests were averaged for the" classes 
. that were in the same building, an analysis of covariance of posttest and outcome 
measures of all available classes would show results. similar to results of other 
analyses. The covariates for these analyses, as with the analyses of districts, 

were pretest (averaged for classes within a given building) and % %\ki graders 
* ■ ■* 

,* " ' ' * 

(averaged for the same classes). The sample size after averaging and after dele- 

\ ' ' ' * ' - 

^tlonsJpr^iplssJngLdata^^^ = 3i3.)v 

^ Table ilI-49 gives the p-values of the K-tests of the analyses of co- 

variance of independent classes for each .posttest and Follow-up 2 measure, ^ 

.and also for three of the. analyses whoso p-yalues were listed in Table III-47. 
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Table III-48 • 
Number of Schools With One Class Per School 
and With More than Ohe Class, by Group 



Number of Classes 
Per School 



3 
4 



MACOS 
29 (51%)* 
4(14) 
4 (21) 
2 (14) 



Non-MACOS 
27 (53%)* 
. IP (39) . 
' 0(0) 
. 1( 8).- 



*Percentage of total classes in group. 



ft. 
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The reason for repealing the-figures from that table is for ease of comparison 

with the results for the analysis of classes averaged within schools. 

It may be seen in Table nM9 that the p-values of tests for classes 

averaged within schools (Column 1) -follow quite closely the result? of analyses ' 

.of covaria*nce^f posttests (Column 2), as did the MACOS effects in the district ^ 

analyses. : The most striking.difference is that WA and\^^TB show a stronger 

treatment effept when independence of units (classes) is brought about (within 

the limitfif of nesting In districts). It may be seen that the similarity ofresults 

extends to the Follow-up 2 measures as well as to posttests. It follows from 

the similarity of results in Column 1 to those in Column 2 that Column 1 re- 

Its differ from those in Colum 3 and 4 (in which student PC's were the co- 

vamtes) in predictable ways. ' . — ^ . " - - 

The analyses of covariance for which p-valuas of F-test^ are shown 
\ . ■ . < ' 

\ > • * / ' ' • 

in Columti of Table 111-49 showed one noteworthydifference from those in Column 2 

and a similarity to those' in Columns 3 and 4. iHie apalysis ofWVfA^ when 

classes within schools were averaged, 'showed a heterogeneity ofregression, 

as it did in the analVses using student PC's. HoNvever, »when eac.h covariate for 

the classes averaged analysis (Column 1) was tested, neither covariate alone, 

. A , 85 ^ ' 

(pretest, % 5th graders) showed significant heterogeneity. 



\ 

\ 



■ 85 . For the homogeneityj of slopes test for pretest: Fj^ 70 =^2. 453 
„ p ^..12; for % 5th g^faders, ^i^i^^- ■ 750, _p ^. 39. 
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. Table III-49 ' 
P-values of F-tests of Analyses of Covariance 
WUh Classes in Schools Averaged, and of Analyses 
of Covariance Using Different Sample Sizes and'Covarlates 



Outoome 

Variables 
AP.. 
STEP 
JDT 

SS Ch ] 
WWA I 

CAPS-1 
.CAPS-:2 

CAPS-3 
'CAPS-4 



MAC OS vs. Non- 
MACOS.Classes 
in Schools Averaged 
VN=74>i/ 
* .000 
.766 - 
■ . 100 

.243 V 
. ,.002 
003 
681 
-.115 

611' , . 
..428 ■' / 



Fdllow-up 2 ^ 
AP1-4F ' 
SSChF - 
WAF 
WBF 



.019 
.698 
.571 
.181 



\ 



•2 

MAC OS v^. 
Non-MACOS 
Posttest Analyseis 
<N=108)^ . • 
VOOO ' 
• .396 
.125 

. 227 ■ ^ ■ ' 
.025 ■ 
.058 ■ - ■ 
•215 

' . io^>' 

.;.225 ' ' 
' .527 , 



. Ql l' 
' . 318 
.366 
.210 



3 

MACOS vs. 
Non-MACOS 



MACOS vs. 
, ^ Non-MACOS 
Using Stud.ent PC's |f Using Student PC's 
• (N=102>1/ ' ^ ffl=8ld,/ 



(N=102>: 

.000 . 

.310 

. 244 4 

.367 

.161 

.509 

.035 

.720 
,^.839 
'.'295. 



.003 
. 293\ 
.434 ' 
.041 



(N=81)2,^ 
.000 
.54'8 ' 
.611- 
.. 98i 
.0.90 ^ 
^6iB6 
.065 
.538' 
.889 
.300 



.013 " 
.309 
. 701^,-*' 
.116 ' 



1. Covarfates: pretest and % 5th graders. ' • - , 
"2. Covariates: pretest and % 5th graders (Note: N's for Fallow-up 2 are 98 except for 
(SS Ch, for which N'=,97). • ..j ' - 

3. Covariates: student input, process »ind climate PC's., . 

4. Covariates: student inputV process and climate PC's. 
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* As a farther means of examiofng the effects of some classes belag in 
the same schools, a reanalysls of the multivariate ANGOVA was done/ That 
analysis, it will be recaUed, tested the difference between MACOS and non- 
MACOS*classes on-20 criterion variables simultaneously, using student PC*s , 
as covariates. .In this analysis; PC.'s of clasa^es within the same schools were 
averaged^ as weir as outcome variables* The question of interest was: to ' 
what extent were majbr findings r^licated? ^ / - 

Table in-,50*in Column 1 gives the results in terms of p-<ralues of the • 
univariate ^ests of each dependent variable. The* overall difference between 
groups contlnue^^ to'be significant: F«a 07=2.252, p:6.016.S^ .j^able ni-50 also 
gives for purpdses of comparisoUt the p-values of univariates F^ests ysing: • • 

■ ' ' 1. * Posttest scores adjusted Jor pretest and % 5th graders; 

2*. Posttest and follow-up scores using student PC's as covariates ^ 

(larger sainple);. . . " 

' t " • 

> 3'. Posttest and follow-up scores using student PC*s as covariates 
(re(luced sample). * • » 

Columns 3 and 4 give p-values for analyses similar to those using classes within 

schools averaged (Column IB only for different a^mplC'-slzes andTslasses within 

-schools not*averag\&d. Column 2 is repeated from Table in-i9, Column 2. 



It is of interest to not^^ln Table III-50 that most'maln results are/repeated 

by the analysis described above. AP, AP1-4F, WA and.^nterest continue to shqw 

significant differences the two groups of classes.- Variables such as CAPS-1 and 
• • « « ^ ' * , 

86. . For tti^s analysis, there were 35 MACOS classes and. 31 non-MACOS classes. 



m-213. 



n 



Outcome 
ViHCiables 

STEP 
IDT 

SSCh. f 
WA i 

CAVS-1 
CAPS-2 
' CAPS-3 
CAPS-4. 
know" 
SkiU| J 
^Interest 
^ AP1-4F . 
^VSS Ch F 
SS 

. WAF 

WWBF 

WV'APF 

WBPF. 



V v- ;• • Table 91-50 ' " ' 
P-values of Univariate F-t?8ts of Analyses of Covariance 
of Classes Wilhin Schools Averaged. Using Student PC's 



' as'Govariates* 



MAC OS vs. Non- 

MAC OS Classes 
Within Schools Averaged 
•Using Student Background 
and profcess Clinaate^PC's 
m=66) ' : 



4- 



. ooi*** 

.972 

.293 

.584 

.040* 

,179 

.106 • 

.940 - 

.756' 

.119 

>055 

.142 

,039*^ 

.010**= 

.510 

.936 

.812 

.174 

.308 

.973 



/ 



MACOSvs. 
."Non-MACdS"^ 
Posttest Scores - 
Adjusted for Pretest 

and % 5th draders 
^N = 108> ' 

.000***"^'' . 
, ' .396 , , 
.125 
. 227 
'• .025* 
..058 « 
. • .215 
.100 
. - ■ ^.225 
^ lOO 



.011* 
•.?18 

.366 
.210 



MACOSvs. 
Non-^IACOS 
tfsing Student 
PC's 
(N=97^ ' 

.001**'^ 
.277. 
.346 . 
.497 

.0i79 
.595 
;(^64 . 
-.795 
'.•619 
.103 
.iQ461 
,.01l' 
.013* 
.OOS** 

•«93.. 
.459 
.296 
Y 030* 
.423 
. .504 



1^ 



AIACOS S%. 
Non-MAPOS 
Using Student 
PC's 

;ooi*** , 

* .528 
.605^ 
.916' ■ 
.018* 

' .412 
.063 
.-.ill 
.895 
.446 
.099**. 
.115 . 
, ^ -5 056 
• .029* 
,.600. 
.581 
>• .978 
.318 
.235 
' " ,940 



?ps;..05 

**p^.01 . 

? -rtL^;rLost tables pre^eniing^-values/those^ 

' denoted by asterisks as a vsual aid in identifying variables of f,articular>terest. 



ERiG 



III-214 

2U 



■ 'J 



'and Know approach significance at the .05 level but fall sho|:t of it. ^'^^^BF does 
not approach significance in this analysis. 

Table 111-51 gives the mean?: and standard deviation^ of student PC^s and 
outcome variable of MAC OS and non-MACOS groups of classes for the three main 
multivariate analyses of oovarlance whose r:esults are shown, in Table 111-50 (Columns 
1, 3 ^ind 4). These data are given as a further basis for assessing the -comparability 
of results using different samples of classes from the two groups. In Table ni-51 it 
may be seen that there are variations in means and deviations ifor different variables 



for diffc^renf sample sizes. In most cases the variations do not appear to be severe. 

Particularly encouraging i he relative consistency of the PC^s for the three 

majpr samples shown. With the exception of the MAC OS Glass 2 mean for the re- 

uuoed group- (N=81; the group of.classes with complete student and teaefher data sets), 

\, . . - ' . / * 

inpi^ PC means for both groups do not differ significantly fr.om zero. One of the' 

main consequences of losing classes that may be seen in some of the criterion or ^ 

outcoine varia'bles is tlie reduction in^ variance (e.g. , in the MAC OS groups, SD's 

in the three samples for ypNh range from .93 to .77; they stay essentially constant 



in the non-MACdst^^amples in this case). Ovei*all, Table 111-51 gives the appearance 



of substantial]9^M8iSiJ:^ncy in means and standard deviations among covariates, ^and 

. V 

among the achievement related measures CAP, STEP, IDT) for the three samples of 
classes. There\is more variation in these two statistics for process and climate 
covariates, and for some 'attitude measures. 

^3) Implications . . ' * 
Th^ overall results of district and school analyses nre taken here as 
encouragi'nj. Even with drastieaUy (and non-specified) reduced sample sizes, 
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, Table III-51 

Meafc aad Standard Deviations of Covariates (Student PC»s) 
and Unadjusted Outcome Variables of MAC OS and Non-MACOS 
Groups of Classes, by Samples Analyzed 



Large Group{N=97) Reduced Gr6up(N=81) 



Classes AveI:agQji(N-66) 





MACC» 




-MA COS 


MAC OS, 


Non-MACOS 


MAC OS 


Non-MACOS 


Variable 


M 


SD 


M 


SD ^ 


M 


SD 


M 


SD 


M 


SD 


M 


SD 


PC's 












1 














Ach 


.07 


1.62 


.01 


1. 59 


.12 


- i 

1. 51 ' 


.01 


1.53 


-. 03 


1.6.7 


.03 


, 1.45 


Att 1 


-. 14 


1.^6* 


-.01 


1. 58 


.12, 


'i.28 


-.06 


1.49 


;o9 


1.16 


.'07 


1.56 


Att'2 


^. 00 


1.07 


.08 


1.10 


-.04 


/l.07 


.20 


1.03 


-.12 


1.02 


.17 


1.09 


Class 1 


.02 


1.58 


.11 


1.61 


.05 


' 1.59 


-.00 


1.58 


-.01 


1.70 


.08' 


1.62 




-..-19_ 




- =^01 


. 1^8 


.26 


1.14 


.20 


1.51 


.-24 


. I.:l6_ 


OG- 


— X-»-55 — 


. S'Proc 1 


.27 


1,§3 


-.17 


1. 73 


.14/ 


1.75 


-01. 


1. 84 


.,03 


1.72 


-. 13 


1.80 


S Proc 2 


-Us 


1.68 


.51 


1.57 


-.41 


1.66 


.59 


Jl.58 


-. 56 


1.41 


.47 


1.48 . 


Climate 


.44 

— -' — 


1.34 


-.57 


1.68 


.44 

/ 


1.38 

' 


-.64 

^ ' - ■ — 


( 1.69 


.48 

— 


1.24 

• 


-. 80 


1.65 


r Outcomes 










• /. 












- 


- - - - - - 


AP . 


-.41" 


.94 


-.42 


.80 


-.40 


.89 


-.46 


,82 


.33 


.94 


-.47 


.80 


■ STEP^"^ 


03 


1.03 


.04 


.89 


./09 


.90 


.03 


.89 


.02 


.95 


.'62 


.83- 


IDT 


.,12^ 


798" 


~-:o5 


.94 


/14 


-.94 


-.01 . 


.95 


...16 


.89' 


-. 00. 


.85 


-SS Ch 


.15 


.88 


-. 17 


.96 


.06. 


.84 


.-.18 


.99 


.'24 


".c83 


-.23 


1.C4 


WW A 


.17 


.93 


-.'28 


1.02 


.19 


.89 


-.29 


1.04 


.32 


.77 


-. 29 


1.03 


WVJB 


.16 


.90 


-.. 16 


1.08 


.23 


.77 


-.07 


1.06 


.34 


.74 


-.17 


1. 01 


CAPS-i 


-. 15 


1.05 


.14 


.88 


-.20 


.98 


.09 


.82 


-. 26 


1.01 


-.00 


. .79 


CAPS-2 


•14 


1.13 


. -.04 


.82 


.17 


1.20 


-.09 


.87 


.07 


.95 


-.11 


.84 


CAPS-3 


.10 


1.06 


r-.03i 


.81 


.13 


1.14 


-.09 


.79 


-.13 


.91 


-. 06 


.80 


qAPS-4 


.04 


.92 


-.19' 


.86 


-.01 


.85 


^. 08 


.87 


.00 


.77 


-. 13 


.79 


know 


-.^9 ' 


.90 


.33 


1. 06 


-.31 


.90 


.34 


1.13 


-.40 


.80 


.28 


1.02 


Skillff 


.15 


1.08 


-. 15 ■ 


.86 


^.10 


. 1.11 


-.12 


.86 


.22 


1.08 


-. 08 


.88 


Interest 


.29 


.90 


-.38 


, .93; 


.34 


.89 


-.39 


.93 


.47 


.91 


-.28 


.88 


AP1-4F 


.22 


.91 


-.28 


*i:o.i' 


.21 


.95 


-.25 


1.01 


.35 


.89 


-.22 


.95 


SS Ch F - 


-. 07 


' .99 


.09 


1.U3 


-. 08 


1.00 


.04 


.97 


r-20 


.93 


-.07" 


.98 


SS 


-. 04 


.91 


-.09^ 


1.09 


.04 


.86 


-.12 


1.03 


-.12 


.73 


-.33 


1.06 


W'WAF 


.08 


.95 


-.16* 


Vf 


•12 


.94 


-.10 


.96 


,10 


.89 


-.02 


.86. 


WWBT 


.14 


.-85 


-.24 


l\ It 


\ 2.0 


.85 


-.15 


.95 


.20 


.75 


-.07 


.90 


W\\A1?F 


.06 


.94 


-. 14 




'P 


.89 


-.13 


.87 


.08 


.76 


-.11 


.82 


WWBPF 


.03 


.93 


-.16 




..05 


.87 


-. OS 


1.07 


-. 01 




-.16 


\ .92 



\ 



246 



one contiQUes to see results that for the most part conform to (or are similar to) , 
results obtained otherwise. Means and ^standard deviations of criterion variables 
and covariates remained similar, although these are not shown here* 

With. respect to districts, there is indication of an interaction between 
treatment (MAC OS, nbn-MACOS) with respect to posttest class means for STEP, 
Social Studies Choices^ (SS Ch) and C APS-3 (Tolerance for Ambiguity). None of 
these three measures showed any consistent main effect of treatment. ^But there 
is indication that results one may obtain using those variables as measures of 



. , V!- 

performance with MACOS and other social studies courses may differ in diffcu:^!- 
districts. As noted above, however, detailed analyses of the. characteristics of 
.districts and particular programs within them have not been undertaken. 

r The results of analyses of differences between MACOS and^non-MACOS 
jclasses when independence of classes Js achieved by analyzing only classes (and 
averaged within-school classes) in different buildings support the hypothesis that 
results obtained by other analyses were not unduly biased by the inclusion of 
classes nested in the same building. They do not do so unequirocally, however. 
There is the alternative hypothesis , for example, that changes in results 

Jrom other analyses could also be the result of changes in th(* characteristics 

\ 

of samples. The relative stability or similarity of ma in -results ^with different 



sample sizes, howe\er, is taken as encouragement for inlcrpretat^ns made of 



earlier analyses. 
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IV. RELATIONSHIPS BETWEEN INPUT, PROCESS, ' . 
CLIMATE AND OUTCOME VARIABLES 

A* Canonical Variate Analyses 

I" 

In order to examine relationships between sets of variables more 

extensively a .serifes of canonical correlation analyses was performed. The 

objectives of thesfe analyses were to be able to examine relationships between 

sets of input and process variables to sets of outcome variables, and to 

each other ,and to identify possible variables within sets that appeared related 

' to significant canonical variatesi Thus.fbr example, if'there were significant 

canonical correlations between input and process, it would be of interest to see 

which predictor variables (input PC*s) correlated highly With the predictor c^no- ^ 

nical variate. Similarly, it would be of interest to know which process and cli- , 

mate PC's correlated highly with th^ related criterion canonical variate. Sucj/ 

information would bear on the question of what seem to be relationships of in- 

1 

put characteristics to process characteristics. 

The following analyses were made: ^ 

.Input and Process/Climate :> Outcomes 1, 2 and 3^ 

.Input > Outcomes 1» 2, 3 

'.Input — : — > Process/Climate 

• .Process/Climate Outcomes 1,, 2, 3 

In each analysis, canonical relationships were computed for the total 

sample,* MAC OS only, and non-MACOS only. 

X The question of interactions is not addrcs;scd by such analyses. The 
canonical correlation model gives that weighted linear combination of 
variables that best predicts a weighted linear combination of criterion 
variables. 

2. Outcomes 1, 2, and 3 are, respectively, posttest, Follow-up 1, Follow-up 

IV-1 
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The main results are summarized ia TabIeIV-l\ l-4» This series 



of tables shows, for each set of analyses, the significant canonical correlations 
for each set of analyses . for the whole sample and for MAC OS and non-MACOS 
-glasses separately. It can be seen that there were typically two significant 
pairs ofLcanonicaloorrelations for the total group and that there was never more 
than one for RIACOS and non-MAGOS, The' structure dl the predictor variate 
is given at the top of each sub-table; the criterion variate structure^is.kt the 
bottom. The numbers given for each variable are the correlations of the va- 
riables with the canonical variate, i, e, , the canonical variable loadings. 

It should be noted from the outset that caution is needed in generaliz- 
ing from these analyses, A cross validation study of these variables could- re- 
sult in several changes: the PC's could change; correlations between them could ^ 
change; the canonical correlations could drop to non-significance; aU could happen. 
Canonical correlations, like other correlations, are subject to sampling errors, 
and especially .with small samples to overfitting that produces high correlations 
that shrink upon cross validation. It is unlikely, however, that canonical corre- 
lations involving pre and post achievement tests would shrink to non-significance. 
But correlations among other predictors could change, thus changing the structures 
of predictor and criterion variates, - . . 

' The consequence of this brief discussion is that while statements will be 

made about the data In Table IV- i ^ they will be in the nature^ of hypotheses rather 

\ 

3. For a recent discussion of the problems, and an approach to dealing 
with them, see Weinberg, Sharon L. , and Darlington, I^ichard B. , 
Canonical Analysis Wheti Number of Variables is Large Relative to 
Sample Size. ^Journal of Educational Statistics , 1976. Vol. 1, 4, 
313-332. . ' , 

* ' . IV-2 * ' ' 
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than conclusions from cross vaKdated results. Further,. as an Arbitrary ground 
rule, no attempt will be made to comment on variable 4oadings of less than + . 50 
for these small samples of classes. In addition, no comment will be made 
about the second pair of canonical variates (CV-2) for the total group* 

In TableIV-l,la,it can be seen that for the total group; there were two 
significant canonical correlations, each with its pair of canonical variates* 
In looking at the loadings (correlations) of predictor PC's withHhe first predic- 
tor variate, (the input/process variate under^tTefirst canonical variate, CV-1) 
it appears that the maior variables are pre-ak^ievement (Ach), pre-achieve- 
ment related attitude (Att 1), and older, more affluent students (Class 1). On 
the lst year outcomes side of CV-1, the major variables loading on the canoni- 
cal variate are the post-achievement measures (AP, STEP, and IDT), as well 
as CAES-3 (tolerance*of ambiguitj( )• In effect, when all input'and process vari- 

•» - * - - - 

ables .(PC's) are related to posttest variables, the first canonical variate (CV-l) 
appears to be dominatedby achievement-related variables, ^ , 

Looking^ across at' the MACpS and non-lVIACOS group in Table IV- 1,1a, 
one can see thlat only the first CV was significant. The predictor variate 
structure, related to total group CV-1, for both groups is similar, although 
S -Proc 1 appears to take on^a little more significance in the MACOS group. On 
the outcome side for both groups, achievement measures have^the highest load- 
ings. But in the non-MACOS group, CAPS-1 and 2 appear tojoad on the variate 
as well. In effect, for the non-MACOS group, posttest performance, on achieve 
ment measures and self attitude .scales appear more generalized, 

IV -3- 
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. Table IV -1, Ib'sh^ws relationships of iiipvA and process to Follow-up 1 
outcomes. The relationships are weak; the canonical correlations are relatively. , 
small, andlor the non-MACOS group, not significant at the . 05 level. In the 
MAGOS group of classes there is the indication that the less teacher emphasized 
individual work (T Proc 2) the more students subsequently felt they missed 
learning some content and skills that would have been useful to them in t^eir 
present social studies class. But .they- also found the present class less interesting. 

In Table IV-l^ Ic, which shows input and process variables in relation ^ 
toTFollow-upToutcomes," there appears once agalnToTie in CV^l a generalized 
relationship of pre-achievement and achievement related attitude (Ach, Att 1), and 
age and affluence of the class (Class 1) to follow up performance pn the MACOS 
course related" instrument (AP1-4F) and the two more positive attitudes toward 
customs and people measures QfTWAF and WBF). The relative influence of 
Informal, ^relaxed classes that students perceived as not emphasizing particular 
types of activities (S Procl) is noticeable in the predictor variate (given the 
. 50 criterion) in the non-MACOS group of classes, but not in the MACOS, ^oup. ^ 

Table IV-1, 2a-c shows relationships of input" and outcome variables. 
The canonical variate structures strongly parallel those found when process 
and climate PC's were included as predictors. The implication is that, par- 
ticularly for achievement measures, or attitude meaaures that are correlated 
with achievement ones^ pretest tends to be the predominant predictor of outcome. 

This was noted in other analyses described in Se'ction HI. Again it can be noted 

■ o . ' " 

4. It wilLbe recalled the Skills,' Know and Interest were all scaled such - 
ihat.a-low value was positive and a high value negative. . • 

. ■ ^ /• ■ 
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that the.flrst class PC (Class 1) is strongly related td\the predictor variate, 
. atong with AcK- and Att !• - , ..." \ \ * 

Table IV-l, 3 suggests relationships. between initial characteristics 



of classes and teachers on the one hand, and what teachers did^^r^emphasized, 
as reported by teachers (T Proc 1, 2) and perceived by studentSlS^Proc 1, 2 
and Climqte), It also suggests th^t some interesting differences be^tween these 
MAC OS classjes as a group, and the non-MAC OS* group (which was; it should 
always be remembered,.^ a conglomeration pf various curricula). Taken at 



curricula), 

face value, the overall group pattern leads to the fo^o^ing statement \of rela-- 

■ - - * \ 

tionships:. the older, m oye affluent and h igher achieving the class (Ac^h, Class 1) 

and the less traditional the teacher (T Psy 2 negativeif, the;;more informal, nonr 

grade stressed, group and discussion oriented the class ( S'Proc 1) as rated by 

■ * • a" ' .-^^ • ' \ 

st\idents, and.tHe better the perceived climate (highet satisfaction, less apathy, ^ 

less perceived difficulty of the work). \ 

There are suggestions of variations in this pattern between the R^ACOS- , 

■ ' - . - -.- ' \ 

and non-lVIACOS group of classes. In the MACOS group, the most heavily load- 

^ing' variables are QasiS-jA (older, more affluent classes) and younger, mqr^-non-' 

traditional teacher's (T Demo, T Psy 2 negative). In the non-MACOS classes, the 

structure suggests that pre-achievement level of,classes (Ach), anU pre-achievement 

related attitude (Att 1) load noticeably. Traditionalism also l&ads negaUvely .as in ♦ 

'\ 

the MAGpS classes, but years of teaching experience (T Biemo, vvhich can be^^taken 
as a prpxy of age) has no relationship to the variatp. Class 1 does not load 
noticeably on the predictor variate in the non-MACOS classes as p group, but does 
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in the MAC OS group! Whether students on the average perceived the clas's 

• . . - , * . 

as informal and group oriented (S Proc 1) correlates strongly with thp process/ 
climate variate in the MACOS group, but not in the non-MACOS classes. Good 
cla'bsroom climate was the most highly correlating variable in the non-MACOS 
classes under consideration here, with lack of individual grades emphasizing 
work also of importance. • . • 

^-^ . , 

■ - In Table IV-1, 4a, b and c,relatj.onships between process/climate and 
outcomes are shown. These are correlations that have not had input partialled- 
out (LeTheld constant). They thus So not uniquely depict relationshipa with" 

"input held constants . 

7^ : " — ~^-6 — — - — 

- Table IV-1, 4a shows relationships to 1st year outcomes (posttests). 
In the total group.the structure of relationships in the first pair of canonical 
• variates (CV-1) suggest^ that emphasis by the teacher and the curriculum, as 
ratAd-by-the'teacher. on group activities, on affect or feelings, and higher order 
cognitive skills (T Proc 1) and good classroom climate, as rated by students, 
are influential as predictors. Oi the outcome sid^thcystructure of the variate 
is similar to that found when both input and process variables were included 
° (Table IV-l, la) with one striking exception. SS Ch (attitude towards social 
studies) here loads highly on the outcome variate. The correlation between sets 
of'va'riables for the WaCOS group of classes was not significant, and therefore 
is not interpreted here. But the relationship was significant for- the non-MAGOS 
classes. There it can be seen that for that group of classes it is the non-achieve 
ment related outcome variables, SS Ch, CAPS-1 (perceived ability of self as 
problem solv'er),' and CAPS-2 (interest in problem solving), that correlate more 
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strohgly'with the outcome variate. - ' . 
- • The marked differences in structures of tJvtf first outcome variate 
between the total group and tJienon-MAC OS -sub-group suggests as one possibility 
Wat the relationships of process and clilnate 'characteristics to achievement and . 
attitude measures operated differently in the'non-MACOS classes than in the MAC06 



classes. f • 

, Table IV-1, 4b suggests that for the total MAC OS and non-MACOS , 

group, goqd climate characteristics and relative absence. o! individual, recall- 
oriented msti^uction (S Proc 2, T Proc 2) are predictive of finding next year's 
. soci'al studies class less interesting (Interest, positive)/ In the MAC OS group., 
marked lack of emphasis on individuafwork and remeubering ( T Proc 2, negative) 
was apt to be associated also with.^|i]ijpies of students from these classes 
feeling, on the average, that they had not been adequately prepared in certain 
skills and knowledge that would have been helpful the following year (Skills and 

Know, positive). • ' - ' ' 

Finally, Table IV-1, 4c suggest that while Climate may not have had 
predictive relationship to Follow-up 2 outcomes in the MACOS classes, poor , 
classroom climate in the non-MACOS classes and emphasis on individual, non- • 
group oriented iork (T Proc 2)" appears predictive of negative attitudes a year 
' later towards social studies (SS Ch F, SS) and towards the behaviors or beliefs^ 
'described in WAF. In the MACOS classes, S Proc 1 is predictive of performance 
on the MACOS sVecific instrument (A P1-4F), ,That relationship's not found in the 
non-MACCfe group. - - 
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Table IV-1, la. ' . . * 

Summaries of Canonical Correlations and Canonical Variate.Correlations 

by Analyses and Group 



4 



TOTAT.OHOUP 



C V-l - 
Correlations 



■CV-2 
Correlations 



MAC OS 
C orrelatlons 



NON-MAC OS ■ ■ 
, CV-1. 
Correlations 



- Annl'vsis 


He \ - , 92*** 


He 2 70** 


He 1= . 92* - 


i\C 1 — • 




Input /Process 


Ininit /Process 


Input/Process 


In|)Ut/Pi*ocess 


1. Input and " 
Process vs^ 


Ach^ 


.94 


-.'25 


.94 


. 89 


' Att 1 


.-71- 


< 

.21 


.56 " 


. 72 \ 


^ , 

Outcome 


Atf2 


.20 


.50 


.20 


.31/ 


a* •First year 
• jj^outcomes 
'(posttest) 


Class 1 


.66 


-.17 


.63 


.63 . ' 


Class 2 


.15 


.14 


.07 


. 19 


T Demo 


-.10 


.10 


-.21 


• 05 . 


T Psy 1 


-.12 


-.03 


. 05 


- . 28 ' ' \ — ji 




T Psy 2 


-.17 


-.26 


-. 02 


-^.-22 . N 




S Proc 1 


.48 


-.43' 


.56 


..42 . 


• 


S Proc 2 


-.09 


" -.42 


■ -.08 


.06 \ 


r 


' T Proc 1 


.18- 


. 39 - 


-.07 ■ 


. 36 ' 




T Proc 2 


-.d3 


>■ .06 


.25 


-2^-^ ^\ 




— 

Climate 


.32 


.61 - 


«. 17 


. 35 




1st Yr Outcomes! 


IstYi* Outoomes 


1 Yr Outcomes. 


1st Yr Outcomes 




■ AP 


.74 


•■ -/07 


%70 


.79 




STEP 


.90 


-.13 


.94 


.95 


O 


IDT 


.81 


-. 19 . 


.81 


. 73 




SSCh 


.16 


.72 


-.09 


.25 




WA 


.35 


. 26 


. 32 J 






WWB 


.42 


-.40 


.38 


« .36 , . ' 




. CAPS 1 


.38 


.26 


. 29 .. 


. 56 




CAPS 2 


.31 


.59 


.19 


51 




CAPS 3 


.73 


' .26 


.65 


.79 ■ ■ ' 




CAPS 4 


.18 


.35 - 


.08 


'.34 1 


/p^.05 
**p^.01 
***p^ . 001 






o 

«^ 


t 




' - ^ NS = Not significant. 




4> 







\ 

. \ 



Note: Sample sizes in all. analyses in Tables lV-1, 1-4 are: Total Group, 81, MACOS 45, 
non-MACOS, 36. ' " 
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TablelV-i; lb. 
Summaries of Qanonic.al Analyses 



TOTAL GROUP 



Analysis 



CV-1 
Corrcl.Ml ions 
He 1 =.54* 



CV-2 
Corrclnliona 
Rc:NS 



MAC OS 
CV-1 
Correlations 
■ Rc 1=.76* 



NON-MAC OS 

CV-1 • 
Correlations 
Rc:NS 





Input /Process Input/Process 


Input/Process 


• 

Input/Process 


l^u Input and 


Ach 


.11 i 


• -.02 


-.05 




Process vs. • 


Att 1 


.08 1 


:63 


-. 01 


^ ' 1Q 


Oiitcon^es 


Att 2 


' -.27 1 


-. io 


.•25 


. . 07 


b. PoUow-up 1 


Class 1 


.09 


.17 


-.01 ' 




Class 2 


-. 07 ' ' 


r-.29 


31 






T Demo 


.02 


-.31 


11 


41 




T Psy 1 . 


-.20 


.11- 


- -.1^ 


, . '-. 52 - 




T Psy 2 


.16 1 


-.29 


.29 . 


V : , - -.33 '. 




S Proc 1 


.32 J 


-.03 


.23 


.39 


■ . ■ .' \ • 


S Proc 2 


-.41 


-.73 


f/.18 


• •.' '.40.1 




' T Proc 1 


-.17° 


.26 


'Ji- -. 15 


i -.1$ 




T Proc 2 


• -.48 


1 -.55 


• -.52 


-.20 




"Climate 


.26 1 


I ■ . . 56 • 


.20 ? 


':A05 




' \ 

FU-1 Outcomes 




FU-1 Outcomes 


FU-1 Outcomes 




Skills 


.68 


! ■ -. 29 


« ; 3 

,..56 


t> * 

.10 


> 


Know 


.51 


\ ' -.80 


" .60 , 


• .86. 




Interest 


.43 


i .88 


.^8 


7.21 




J . , 







NS = not significant. C'vrrelations with variate showhy.but offset to right. 
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♦ Table IV-l, Ic. 
'Summaries of Canonical Analyses 



X ■' 

TOTAL GROUP' 



An:ilvsis 



• -cv-i ■ ' CY-2 - ■ 
Corrchifjons • Correlations 
' Ik- 1 ^.79*^*'*. no 2 - ..59* 



MAC OS 
CV-1 , 
C orrolatltins 
Hcl-:83** 



'ir NON-MAC OS 
CV-1 ; 
Correlations 
' " Rc 1 = . 89** 



'I ■ . 



1. Input aDd 
Process vs» 


• > * 

I^tput/IVoccss 
Ach 88 


Input 'Ptrocjesst 

— * -r—, 

' 13 r * 


Input/Process 
-80 


Input/process 
.75 


Outcomes^ 


A.tt 1 • 


.63 


f 


;47 


' .50 ^ 


c. 'Follow-up 2 


Att 2 


-.12 


-.00 


-.34 


-.05 






class 1 


.78 . 


-.22* . . . 


.78 


.73 ■ 






Class 2 


-.01 


..04. ' . - 


.01 V 


. -. 03 , ' ' 




• 


T Demo 


.01 


.'35 * 


-.22 


. " .02 / 




T Psy l- 


-. 17-, 


.16, 


.04 , " 


. -.06 ' ' 




* * . * 


T Psy 2 


-:34 


.-.30 " 


-.04 


-.34 • 






« Prpc r 


.45 


-.51 


" .38 


."1 






S Proc 2 


-. 04 


-. oi -4 . ■ 


. O.-) 


.42 






^ Proc 1 


.10 


.41 


-.14 


* -. 04. 




T Proc 2 


-.08 


: -.15 


.17 ■ 


-.31 ♦ 




Climate 


•. 21 '■ 


.53 


-.25 


-.07 




^FU-2 Ou.teomes 


FU-2 Outcomes 


FUr2 Outcomes 


FU-2 Outcomes 




AP-F ■ 


.92 


' -.24 


' .85 


■ .78- 






SS Ch-F 


.04 


■ .01^ 


,06 ■ 


' -.02 






WWAF ■ 


.51 ■ 


.27 


."57 


■ . 41 




WWBF 


.68 . 


.27, 


.65 


. 53 




• ' - X 


WWAPF . 


-. 07 


-.21 


.48 ■ 


-.66 






W'WBFP 


.17 


■ .-26 . 


•* ,40 * 


i 08 - 




iss ■ 


.11 


• .63 


-.•13 . 


'j.Ol * 



t . 



'\ *p-^. 05 

'Vp^.oi ' 

*^*p^.001, 



A. : 



4=* 
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Table IV -1. 2a. ■ . 
Siimmaries of Canonical Analyses 



TOTAL GROUP 
CV-1. CV-2 
Cprrelations Correlations 



MAC06 
GV-1 
Correlations 



NON-MAC OS 

CV-1 ■ 
Correlations 



Analyaft : 


He 1=^.92*** 


Rc 2=> 61* 


Rcl=.90** 


Rc 2= .97*** 


f • ^ 

'2. Input V8. 
Outcomes ' 


Inputs 

Ach 


.95 


Inputs 
-. 28 


Inputs 
.96 ' . 


Inputs 
.91 


First Year 


Att 1 ' 


.72 


.23 


.64 


^ .72 


Outcomes 


Att 2 


.17 


.83 


.16 


■.27 


(Posttest) 


Class 1 


.68 


-. 31 " ' 


.64 


.66 . 




Class 2 


.13 


.12 


. 01'»" 


.18 




T Etema 


-. 07 


.07 


-.17 


.08 




T Psy 1 


-.10 


-. 03 


.04 


-.28 




T Psy'^ 


-. 16 


-.25 


. .02 


■ 22' 




1st Yr Outcomes Ist Yr Outcomes 


1st Yr Outcomes 


l3t Yr Outcomes 

s 




AP 


■ .73 


-. 05 


.73 ' 


' .'80 




STEP 


• .95 


-. 14 


.92 


.941 




IDT ■ 


.80 


-. 14 


' . 81 ■ ' 






-SS Ch 


.11 


.48 


-. 08 


.20 




^\WA 


.41 


-.05 


.44 


.28 ' . 




WB 


"41 





.40 


.35 




CAPS-1. 


•'.36 


o * •.21 h 


' .30 


.55- 




CAPS-2 


.28 


' .65 


. . 17 


• ' .48 ■ - 


1 # 


CAPS-3 


.71 


• .45 


.64 


.78 




CAPS-4 


■ .18 


.64 1 



;04 


. ..33 • 



*t>5.05 
+*P5-. 01 
***p<.091 
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* Table IV-1, 21^,. 

Summaries of Canonical |f\nalyse*s 

- \ . 



Analysis 



TOTAL GROUP 

Gv-1 ev-2 * 

Correlations Correlations 
Rc 1: NS Rc 2; NS 



MAC OS 
CV-1 
CprreFations 
Rc 1: NS 



NON-MAC 06 

CV-1 
Correlations 
Rc 1: NS 



2. Input vs. 

Outcomes 
b. Follow-up 1 



Note: Correlation of variables with canonical variates not listed 

because the canonical correlations did not reach significance. 



NS = not significant. 
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Summaries of Canonioal Analyses 



TOTAL 



Correlations 



Input vs. 
Outcomes 
3. Follow-up 2 



Analysis 



\ 



GROUP 

CVr2 
Correlations « 
Rcl=.76*** Rc 2 =. 49* 



MAC OS . V 
CV-1 
Correlations 
Rc 1 =. 82*** 



7 
i\ 

NON-MAC OS / . 

CV-1^- / " 
Correlations / 

Rc2= /78*- / 



Inputs 



Ach 



Inputs 
.06 



Att 1 



.64 



Att 2 



.15 
,24 



Cl-ass.l 



.Tie 



-.05 



Class 2 



.01 



-.13 



T Demo- -. l'5 



-.03 



TPsyl -.15 



,80 



T Psy 2 -. 34 



-.25 



FU-2 Outcomes FU-2 Outcomes 



AP(1-4)F .94 



-.29 



SSChF .08 
SS' .10 



-.10 



04 



mVAF 



54 



,66 



WBF 



.02 



24 



WAPF -.04 



-.42 



WBPF .15 



27 



.*p^ .05 
**p^.01 
***p<.001 



Inputs 
.88 



,54 



-. 26- 



.80 ' 



-.05 



-. 17 



08 



/ -.08 



U-2 Outcomes 



;90 



12 



,02 



59 



63 



,32 



33 



Inputs 
.88 



.64 



T 



.03 / 



82 



' .05 / 



-: 19 / 



-. 10/ 



-.36 



/ 



FU-2 CKitcomes 

- / 



.'84 



i 06 



;.02 



.64 



72 



/-. 31 
/ .09 
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Table lV-1, 3 
Summaries of Canonical Analyses 



.TOTAL GR OUP 
GV-r 



CV-2 



MAC OS 
CV-l . 



NON-MAC OS 
GV-1 





Correlations 


Correlations 


Correlations 


Correlations 


Analysis 


Rc 1 =. 


67*** 


' Rc§:NS 


. Rc 1 =. 74** 


Rc 1= .85** 


3. Input vs^ 


Input 


s 


- Input 


Inputs 


Icnuts 


Process 


Ach 


.59 


.59 


.41 


.51 


Att 1 


• .48 


.38 


.26 


.'51 




Att 2 


.17 


.02 


.23 


.48 




Glass 1 


.61 


.61 


.61 


- .34 




Class 2 


.07 


-.00 


-.24 


09 




T Demo 


-.37 


-.08 








T Psy 1 


-. 08 


■ -.23 


,13 


-. 06 




T Psy 2 


-. 74 


.64 


-.67 


-.52 ' 




Process 


Process' 


Process 


, Process 




S Proc 1 


.76 


.44 


.82 


.31 




S Proc 2 


-.38 


.32 


-.46 


-. 05 




T Proc 1 


.39 


-.05 


.43 - 


.25 




T Proc 2 


-. 46 


.76 


25 


- -.49 




Climate 


.59 


-.40 


.51 


.79 



*P:$.05 
**p^.01 
**<'P:5.001 



NS = not significant. Correlations with variate shown, buc offset to right. 
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' Table IV -i. 4a. 



Summaries of Canonical Analyses 



TOTAL GROUP' ^ MAC OS NON-MAC Q6 







CV-1 




v.* V — 


\J V ■•J. 








Correlations \ 


Correlations 


Correlations 


Correlations- 




Anal vQiQ 


Rc 1 = . 




1.1 W Oif 




X!\C ± — • Oo 


4 




Process 


jr roc ess 










S Proc 1 


.15 




' <'53 




dim 


r IX St X G<XL 


3 Proc 2 


-.37 












T Proc 1 


.53 


- — . lb 


♦ *t 1 


• Ox 


- 




T Proc 2 


-. 08 






« ux ^ 






Climate 


.89 


AQ 
— . VO 


» OO 








1st Yr Outcomes 


1st ir (jutcomes 


1st xr uutcomes 


Xox xr uutcomes 






AP 


.55 


' ".55 


.50 


.08 






STEP 


.52 


,60 


. 58 


.30 






IDT ' 


.39 


.60 


.-49. 


.07 - 






SSCh 


.79 


-.29 


. 58 


.65 






\V\VA 


' .26 


-. 10 ; 


. -.14 


.40 






\V\VB 


.53 


. 05 


.36 


.44 






CAPS-1 


.43 


-.12 


. .25 


.57 






CAPS-2 


.45 


-.20 


• . 23 


.61 


1 




CAPS-3 


.54 


.58 


.70 


-. 00 






CAPS-4 


.22 


-.28 


.03 


..39 



*p^.05 

**pj.01 ' ' . 

***p^-.001 

NS = Not significant. Correlations with variate shown, but offset to right. 
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r - . T afate^^^ ly -t-^r- -; 

Summaries of Canonical Analysed , 





TOTAL GROUP 


M AC OS 


NON-MAC OS 






\j V— 1 




CV-»1 


- CV-1 


* • 




Correlations 


Correlations 


Correlations 


Gorreigtions 




Analysis 


Rc 1 =.45*** 


Rc 2 =..38* 


Rc 1 =. 51* 


.Rc: NS- 




4. Prppess vs 


.Process 


Process 


♦ * 

Process 


''process 




Outcomes 


5 Proc 1 . 18 


C A 

. 54 J 


. 43 




24 


b. Follow-up 






.15 ' ■ ■ 


.83 


1 


T Proc 1 . 20 


-.52 


-.3b* 


• • 


58 




T Proc 2 65 


-.49 


-. 84 


.37 




Climate .77 


.16 


.47 




29 




FU-1 Outcomes 


FU-1 Outcoiues 


FU-1 Outcomes 


FU-1 Outcomes 

* 




Skills • 19 


' .83 


.73 


.93 




Know -.45 


.72 


.59 


.64 




Interest .97 


.23 


. .60 - - 


:o8 • 



*p^.05 

**p5.oi ^ ' " 

NS= not significant Correlations with variat§ shown, but offset to right. 
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- Table IV -1. 4 c. 



Summaries of Canonical Analyses 



-Analyais 



T0T:AL GROUP 
CV-1 ^ ■ CV-2 
Correlations' Correlations 
Bel-. 49** Rc ; NS 



MAC OS 
CV-1 
C orrelations 
Rc 1 = .68** 



NON-M'ACOS 

cv-r 

•Correlations 
Rc 2 = .65* 



— — — 

4. Process 


r • 

Proces.? 


Process 


Process 


Process 


vs. 


S Proc 1 


.79 


\ .31 


.71 . 


-.13 


outcomes 
c. Follow-up 


S Proc 2 


.06 


-.37 


-. 19 


.03 


T Proc 1 


-. 42 


. 41 ■ 


-.26 


.08 


_ 2 


T Proc 2 


.13 


-.18 


.35 


.82 




Climate 


-.18 ' 


.92 


.21 


-.70 \ 




FU-2 Outcomes 


\ 

, FU-iJ Outcomes 


FU-2 Outcomes 


FU-2 Outcomes 




APa-4>F' 


A 62 


.71 


.80 


-.18 




SS Ch F 


-. 10 


. So 


. 14 


Ad' 

-.48 




SS 


-. 55 


■ .70 


-. 13 


-.61 




WWA'F 


-.06 


.34 


-. 13 


-M 




\WAB 


-.03 


.32 


-.25 


-.19 




W^VAPF 


-. 08 ' 


-. 14 




.23 




W'WBPF 


-.01 


.18 


-.12 


-.36 


- **P^-01 
***p<.001 




» 




* 


♦ 


NS =-Not significant. 
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